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COMBINED EXPANSIONS OF PRODUCTS OF SYMMETRIC POWER 
SUMS AND OF SUMS OF SYMMETRIC POWER PRODUCTS 
WITH APPLICATION TO SAMPLING^ 

By Paul S. Dwyer 

PREFACE 

This article is divided into two parts. Part I has for its title “Combined 
Expansions of Products of Symmetric Power Sums and of Sums of Symmetric 
Power Products^' and develops the general mathematical theory which is ap- 
plied in Part II to “The Fundamentals of Sampling.” Part 11 will appear in 
a latter issue of this journal. 

Each part is treated as an organic unit and has its own introduction and 
bibliography. Each article is assigned a given number and each book is given a 
letter so that references can be indicated concisely in the body of the dissertation. 

Each part is divided into chapters and sections. Braces are used to indicate 
the important formulas. 

PART I COMBINED EXPANSIONS OF PRODUCTS OF SYMMETRIC 
POWER SUMS AND OF SUMS OF SYMMETRIC POWER PRODUCTS 

Introduction 

The mathematical material which is presented here has proved useful in 
generalizing that portion of the fundamental theory of sampling in which 
relations are established between the moments of the sample and the moments 
of the parent population. It is the purpose to establish the theorems in algebraic 
form since they constitute an extension of partition and symmetric function 
theory and may be of value to someone not necessarily interested in sampling, 

A great deal of work has been done in symmetric function theory but not 
much of this is of present value to the statistician. His problem deals with 
the “power sum” while the classical theory, for the most part, deals with the 
interrelations of elementary symmetric functions and monomial symmetric 
functions. Only one phase of the reasoning developed in this investigation 
seems to have received extensive consideration previously and that is the subject 
covered in Chapter III, 

Previous authors have noted that much of symmetric function theory re- 
duces, with a proper choice of notation, to partition theory. It is the plan of 
this treatise to present in Chapter I an outline of new partition theory which 


1 A dissertation submitted in partial fulfillment of the requireme-nts for the degree of 
Doctor of Philosophy in the Univeiaity of Michigan. 
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shows how the parts of one partition are combined to form the parts of another 
partition, and which serves as a means of expressing the main result of Chapters 
II, III, IV, V. 

Chapter II shows how the formulas of Chapter I are applicable to the problem 
of finding products of power sums. The multiplication theorem for power 
sums, a generalization of the multinomial theorem, is stated in terms of power 
product sums and appropriate special cases ate indicated. 

Chapter III deals with the expansion of power product sums in terms of 
power sums and shows how the formulas of Chapter I may be used. 

Chapter IV is the key chapter of the paper. The problem is to expand 
products of power sums in terms of power product sums, to multiply each 
power product sum by a quantity which is a uniquely defined function of the 
quantities composing the power product sum, and then to expand back in 
terms of all possible power sums. It is shown that the results can be written 
in a compact form 't/hich also utilizes the results of Chapter I. This result, 
as is shown in Part II, is directly applicable to the sampling problem of finding 
the moments of the sample moments in terms of the moments of the universe. 

Extension is made to multivariate distributions in Chapter V. 

Chapter I. The Combination of the Parts of Partitions 

It is the purpose of this chapter to provide a precise notation which shows 
how the parte of one partition of r may be combined to form the parts of another 
partition of r. For example, 2111, a four part partition of 5, can be made 
into 32, a two part partition of 5, by combining the three unit parts into a new 
part or by combining the 2 with one of the unit parts to form the 3 and the 
other two unit parts to form the 2 . This last formation can be made in three 
different ways since anyone of the unit parts might be combined with the 2 . 
The combination of the parts of the partition 2111 to form the parts of the 
partition 32 is to be indicated symbolically by P 31 -f ZPn where the subscripts 
indicate the number of parts collected and the coefiBcients indicate the number 
of ways in which an equivalent collection can be made. 

1. Defimtions and Notation, a. Partition [fr; 105] [if; 7; 1 ] [16; 105]. We 
consider the integer r to be composed of r unit indistinguishable parcels and 
define the partitions of r to be all those different groupings into new parcels, 
each new parcel containing one or more unit parcels, such that each resultant 
grouping of parcels contains exactly all the original r unit parcels. For example 
the partitions of 4 are 

4 ; 31 ;22 ;2n ; 1111 

b. Paris of Partihons. The numbers of the grouped unit parcels indicate 
the parts of the partition. Thus the partitions of 4 above 

4 ; 31 ; 22 ; 211 ; 1111 have respectively 

1 ; 2 ; 2 ; 3 ; 4 parts. 
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The pattern 22 may also appear as 2^ In general a p part partition of r is 
to be designated by 

"PiVipi • • ' Vp where the p's may or may ngt be equal and where pi + P2 -b Vi 
+ ■ • • -b p, = r or by 


• N p, 

Pi^ • • • pt’ where < Pi Ti + pzxj + • • • -f pair, - r 
Tl -b 712 4“ ' • • TTa ~ p 


c. Order of Partitions. When the parts of a partition are arranged in de» 
scending order we say that the partition is ordered. Thus 


PjP 2 • • • Pp is ordered if Pi > P2 > ps > • * • > pp 

and pr — pr* is ordered if pi > P2 > ps > • • ‘ > p/i . 

For example, 21® is an ordered partition while 312 is not. Unless otherwise 
specified it is heressfter assumed that all partitions are ordered. 

It is sometimes convenient to refer to the order of the partition which is 
the size of the largest part, pi , when the partition is ordered. Thus the two 
part partition, 31, is of the order 3, while the four part partition, 1111, is of 
order 1, The set of the numbers pP • • - pP is to be known as the complete 
order. 

These definitions of order and part are consistent with the usual definitions. 
[16; 105-106] [K'j I; 1] [(?; 100]. The concept of complete order, as far as I 
know, is not found in the literature, 

d. Weight of Partitions. Isobaric Pariiiions. The weight of any partition 
is defined to be the sum of all the parts of the partition. Thus the weight of 
pP • ■ • pp is piiTi -b PziTs + • ■ • H- p.ir, - r. Partitions having the same weight 
are called isobaric. Thus 4 and 211 are isobaric partitions. 

e. Algebraic Partitions. If the r original units are composed of oi , 02 , 03 , 
■ . • nonseparable primary units, then the result of combining these in any 
possible way is to be called an algebraic partition since the r original units 
are now replaced by the r algebraic quantities Oi , 02 , * • • o,. . Thus ai, Oi, oa 
may be combined to form 


di "b Qa "b Ua ; tti + O2 ' ; Oj + ds • dj ; Qj + 0$ ■ di) fli • fla ‘ Os 

which are the algebraic partitions of oi -f <22 + ds ■ 

The parts of the algebraic partitions are the resulting combinations while 
the order and complete order, which indicate the numbers of algebraic expres- 
sions combined, agree with the order and complete order of the partitioiis in 
which the a’s are unity. The weight, which is equal to the sum of the parts, 
is indicated by to = ai -f 02 -f ■ • • -f dr . Thus if di = 5, 02 = 4, and 03 = 3, 
w — 12. It is to be noted that the algebraic partitions are formed by combining 
the parts 5, 4, 3 and not by combining all parts of 12. 
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Now Qi Oa • • ■ Or is itself a partition of weight y) == Ci + 02 -f- • « • -f- a, . 
If groups of the a’s are alike it may be written 

a?* cip • • ■ where 

’4" *^*2 -j- . . . UftOCh — w 


ai -f" ®2 "{" • • • “I" 

Algebraic partitions having the same weight are called isobaric. 

I Partition Combination Notation, Let( ^ indicate the number of 
difiexent ways the r units, ordinary or algebraic, can be collected to form the 


partition. Thus hidicates the number of ways in which the five units 

can be collected to form a partition ivith three units in one part and two units 
in the other. Since the three units forming the first part can be selected in 
iCi ways and since this selection automatically indicates the other two units 
forming the second part, it follows that 


©■ 


iCa ~ iCa ~ 10. It is to be noted that 


0 - 


3 H ,(72 = 6 


for if the four unit parts are oi , Oa , a, , a, , then the three 22 partitions are 

d* a2' a* "h a*) Oi “h fta’Oa “h at “h U 4 ■ 02 "h 03 

since 

ttg d" 04’ Ol 'h 0 - 2 ) Oj -|- -f- O 3 ; ^2 “h Og' Oj H" 04 

are essentially the same groupings as the first three indicated. 

2. Formula for ^ ^ In establishing this formula we first take the 

case in which no part is repeated, i.e. tt: = tj * • • ira = 1 and Pt + P 2 -f pa 
• • ■ + p» = r. In this case the formula becomes 

r \ r! 

This results from the fact that the pi units can be grouped in rCpi different ways. 
The ps units then in ,_p^(7p^ different ways, the pa units then in r-m-pjClp, dif- 
ferent ways etc. So that 

~ r(7pi'r-px(7j)2<r-pjwj)jCpj r-Pi~Pi,,‘P,~iCp, 

Compare [B ; 49][19 ; 12] 
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If however pi = pi = • • • - p^, then the same partition has been used s ! 
different times since pi, ps, may be interchanged in s! different ways, 

so that 


By similar reasoning 




rj 

' • • (PjO’"' tti! 7r2? • • > x,! 


[1] 


Compare [19; 12, 13] [I; II, 252] 


( cti ^aj _ _ ^ 

Is " ' tr J. The number of ways in which the r parts of 
Pi Pi ■•’p, / 

ai“har • • • 0“* may be collected to form the p parts of ■■■ pi’ may be indi- 
cated by 


/ar^ . • • ar\ 

\pr pv --pi’/' 


Thus 



and 



= 3 


Formulas useful is evaluating this expression can be worked out from the results 
of this paper. A table of values of this expression for w < 8 has been given 
by the author [19; 29-32]. 


4. Notation for Combining the Parts of a Partition. Table I, We wish 
to indicate not only the number of ways in which a given r part partition of 
weight w can be grouped to form a p part partition of weight w, but also the 
number of parts of the r part partition grouped to form each of the p parts 
of the p part partition. As indicated in the opening paragraph, Pai ZPn 
/211l\ 

= P! ) serves this purpose for the case in which the parts 2111 are col- 


lected to form 32. P 


ar..-ar\ 
\pP pP ■ • • ply 


serves this purpose in the more general 


^pi‘ps‘---pl 

case. Its expansion gives sums of P functions whose subscripts are the numbers 
of parts combined and whose coefficients are the number of ways of forming 
the partitions from the parts. For example 



(»)- 


3Psi; etc. 


The use of P 




G/i 


is so fundamental to the present approach that a 


'Pi' -’-P> 

table is provided showing the different values when w < 6. 

Table I gives values of the function when w = 1, 2, 3, 4, 5, 6, 
af' ■ • • are given in the left hand columns and the values of p*’ 


The values 
pl‘ in 


the top row. The partitions are ordered from the top and from the left. To 
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( 211l\ 

22 j we note that w — 6, look for 2111 on the left 

and 32 at the top. The result is Pai + ■ In the table the order of the 

subscripts is important in indicating the number of parts collected to form the 
respective parts of the ordered pr • - ■ pJ*. 

The values in the table previously mentioned [19; 29-32] may be obtained 
when lu g 6 by placing every P in Table I equal to unity. 

5. Value of P{aP aV • • • The parts of the partition af ^ • • • a** 

may be collected to form a large number of partitions of the type pf' • ■ ■ p,*'. 
Thus the parts of the partition 2111 may be collected to form 5, 41; 32, 311, 
221, 2111. We denote by P(2111) the values 

P f f f f « ) « + P fa”) 32 + f fsn ) 311 + P g“) 221 

+ ^(2111) == 3P«t311 

“H 3P2u 221 Pini2111 

and in general 



where the supimation holds for every partition pV - • ■ which can be formed 
by combining parts of af • • • <*. The values of P{ar • > • ah'*) for lo g 6 
are given in the rows of Table I. Thus the value of P(2111) above is found 
along the row 2111 where w = 5. 

6. Values of P(r) and P(o’'). When aj = 1 and on = r we have 

w)-=2:pf., 

and since there are ^ ^ different ways of forming pp . . . pf* from 
the r units and each way is indicated by Ppji.. .pj* we have 

P(1 ) = 2] ^ • « * pj‘. (3| 

When r = 2, 3, 4, etc., we get 

P(P) =P,2 + Pul^ 

P(1 ) ~ P 3 3 -}- SPji 21 Pm 1® 

P(P) - P4 4 + 4P31 31 + 3?j2 22 + 6P211 211 + Puji 1* 
etc. 

as indicated in Table I. 
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Similarly when a\ — a and ai = r { 2 } becomes 

PW = Z ( n P.v -A- (“Pi)'’ im)" ■ • ■ W (3'l 

since there are ^ ^ different ways of forming the partition (api)*'^ ( 0 P 2 )'* 

. ... (ap,)'’ from the r equal o's and each way is indicated by 
For example 

P{a)=P^“)a = P.a 

^ ( 1 ) + (la) = ®’ 

= KbI) + '’(2I) + a) “ 

P(a^) = P 4 4ci " 1 - 4P3i3Q-a “h 3P22 2 tt' 2 fl -f- bPzuStt'tt -t-Piiufl. 


7. Values of P(o: oj • ■ - Or). From the definition 


P(nx) = Pxax 

P(oia2) = pf ) +Pf“'°'') 

\(ii d" Ca/ \ai02/ 


= P 2 Oi + ^2 d~ Pu Oi as 


PCaiaiUs) = P(_ „ 

\Oi -h aa -j- Oa 


(ai + <fe + a,) + p(-^“= 

yflx -p ‘ ®s. 


(ui + ^2 ■ <^ 3 ) 


+ p (q~ T ~ ^ „ d- «5- as) + p „ )(02 + 03 • Oi) 

\ai d" eta* cts/ \ct 2 d~ 03 • Oi/ 

-f ^3(01 d- aj d- as) 

yaiasos/ 


d- PsiKui d" as' Os) d" (ai clvO^ 4* (a2d"aa'ai)) d" PiuCaiasUs) 
etc. 


Now if complete order of the general partition indicates the number of o’s 
collected to form the partition, the subscripts of the P’s are the respective 
complete orders. If we indicate the sum of partitions having the same com- 
plete order by the term “partition type” and indicate the partition type com- 
posed of all terms having the same complete order 

Pi’ ■ “ pl‘ by 
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then 

?(a,) « PiTi 

P(aiCa) = PiTa -f PnTu 

P{a,aiaz) = P^Tt + PA + PuiTiu 

P{ai(Haia^ - PiTi 4- PaiPai + p2^Pn 4- PuiPiu 4~ P uuPun 

etc, 

and in general 

P(aia2 a.) = {4} 

This formula can be used in writing the formula of Table II or formulas of 
weight greater than 6. Thus 

P(643) is given by PsPa + PnPsi + Pin Pm 

where 


Pa = 12, Pai = 9-3 + 8-4 + 7.5, and Pm = 5-4.3 

where the dots do not indicate multiplication, but merely the separation of 
the parts. 

In general Ppp..,pj. is composed of ^ partitions since this is the 

number of ways in which the a'e can be combined to form partitions having 
the same complete order, pp ■ • * pp. 

Tormula [3'} is a special case of this formula. If the a’s are all equal, the 

^ partitions are equal so that Tpii...pU = ^ pT,^(api)*‘ 

(ap,)'"‘. Substitution in {4} gives {3')- Similarly (4) gives |3} when 
all the a’s are unity. 


8. Geaeralizatioa from Symmetry. The function P{aiai • • • a,) is a sym- 
metric function of the parts ai , 02 , • a, , i.e., the interchange of any two of 

the parts does not change the value of the function. It is possible to use this 
fact as a basis of generalization and to derive 14) from 13) by its use, From 
13) we have 




where is the number of the equivalent partitions which can be 

formed from the r units. In case the r units are replaced, by the r different 
a’s, there will result ( »i ^ r, ) different partitions having the same complete 

\Fi * ’ ' Pi f 
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order. These ( r, ^ », 1 different partitions defined by Tpp...pf» replace the 

\Pi ‘“P. / 


) equivalent partitions of {2} isnd we have 
\Vi '"V> } 


V{ax(h flr) “ 2 jPpp.'.yi* ^ pP-.-pT* 


{4} 


9. The Recursion Rule. It is possible to establish a recursion property by 
which the value of V[a\<h • - • OrUr+i) can be obtained from the value of PfciOj 
• ‘ * Or) . We note, from the results of Table I or by 1 4 } that 

P(3) == Pi3 

P(32) = Pjfi + Pu32 

P(321) = Fad + PnSl + P2i42 + Pi233 + Puilll 

P(32) is obtained from P(3) by symbolic multiplication of its expansion, Pa (3), 
by the expansion of P(2), Pi(2). This symbolic multiplication is accomplished 
by adding the 2 to the 3 and also suflaxing the 2 to the 3. If the 2 is added, the 
subscripts of the P’s are added while if suffixed, the sul^cripts of the P’s are 
suffixed. 

More generally if P(ai) = Pi(oi) and P(o 2 ) = PiCoj), then the result P(fflias) 
= P 2 (ai + (h) + Pai(ai) (og) is obtained by multiplying Pi(ai) by Ps(a 2 ) [or 
Pi{(h) by Pi(oa)l symbolically if the subscripts are added when the a’s are 
added and suffixed when the o’s are suffixed. Similarly PCajOs) = P 2 (ai + Oj) 
-|- Pii(ui) (oj) when multiplied by P(as) = Pifoa) gives 

PCniOjUi) — P 4“ 4" 4“ p4i(oi H“ ®a‘Us) 4" PiiC^i 4" Us'Oj) 

4" Pi2(cti*a2 4* Ua) 4“ Pui(uiOa08) 

when the rule of multiplication is the adding of aa in turn to every part of every 
partition with the appropriate adding of subscripts and the auflixing of Uj to 
every partition with the correspon ding suffi xing of subscripts. It is important 
to note that the P c oefficien t of ai-Os + as is Pis and not Pji although the term 
could be written PgiCg + ■ The applications do not demand the retention 

of a given order of subscripts though the continued application of the recursion 
rule does demand it. 

In general the value of P(ai • • • drUr+i) can be obtained from the value of 
P(oia 2 • . • Or) by the symbolic multiplication of the expansion P(oiaj • • * a,) 
by Pi(ar+i) since all possible algebraic partitions of ai -f oj -f- < • • + o,. + Or+i 
are obtained from all possible algebraic partitions of ai -f Oj 4- • • • -f- Ur by 
adding a,+i in turn to each part of each partition and by suffixing it to each 
partition. The corresponding P subscript, indicating the number of a’s col- 
lected, is increased by 1. 

The recursion rule is useful in checking the entries of Table I. As a matter 
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of fact Table I was computed with its use and the order of the subscripts is 
that which results from its use. The rule is also useful in finding values when 
w > 6 . For example, since 

P(321) “ P 36 + PaiSl -I- Pji42 + Pij83 fi- Pui321 

P(3221) = P 48 + P 3162 -f- P3 i71 + P 2253 + P2u 512 -f P3i62 + P22'i4 

4- P2u422 + P 2253 + Pij35 + Pi2i 332 + Pjii521 4 - Pi2i341 + Pii2323 
4. P]m3212 = P 48 4" Fai?! 4"^ Psih2 fi- (P 31 4" 2 P 22)53 4" P m44 
4* 2P2ii521 4" F21i431 + P2il 422 4- 2P2ii332 4 - Piiu3221. 

A useful check is based on the fact that the sum of the P coefficients of 
P(ai - • ar) should equal the sum of the coefficients of Pfl"). In the above 
illustration the sum of the coefficients is Pi 4" + 3 P 22 4" bP 2 u 4“ Fun as 

desired. 

10. Use of the P Function Formulas, The P function formulas, as defined, 
represent concisely the ways in which the parts of a given partition may be 
combined to get the parts of other partitions. They are also useful in writing 
expansions of certain partition functions whose expanded values arc expressed 
in terms of other partition functions. They are used, in this paper, in expressing 
the multinomial theorem, the multiplication theorem for power sums, the 
expansions of power product sums in terms of power sums, expansions of mono- 
mial symmetric functions in terms of power sums, the double expansion theorem 
itself, the coefficients in the double expansion theorem as well as the sampling 
laws of Part 11. They are also useful in representing the expansions of different 
moment functions and can be associated with important concepts of mathe- 
matics and statistics such as, for example, the differences of 0. Such applica- 
tions, however, are not pertinent to the line of reasoning which is developed in 
Chapters II, III, IV, V. 

Chapter n 

It is the purpose of this chapter to obtain formulas for the expansion of 
power sums. 

11. Definitions, a. Power Sum. Let a; be a variable which is restricted to 
the AT variates, Xi, x^, xs, • • • ,Xtf. Then the o-th power sum of the variable 
indicated by (a) is defined to be 

N 

(a) = ii 4" 4" ■ ■ • "b ^ a;? (5) 

It is assumed for the purposes of this paper that a is a positive integer or 0. 

b. Power Product Sum- The expression 2 is to be called a power 
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product sum since it is composed of the sum of products of tl\e powers of the 
variates. It is to be denoted by (01-02) or (0102). Thus ~ ( 3 - 2 ) or 

( 32 ). The value (a -a) = (a*) = ^ is a special case of (oioa) where 

02 = fli = a. In general the power product sum is defined by the right hand 
member and indicated by the left hand member of 

(oiOs . . . oy) = 52 {6} 


If ii “ iz , the power product sum becomes 

(oi + 02-a3*a4 • • ' Or) = 22; Xi\xT3>"X‘ll {7} 


There are many different definitions since there are many different ways of 
indicating equality relations among the i's. Each results in a unique power 
product sum which is to be called, for brevity, a power product. If the c's 
are all unity, there are many duplicates. Thus for the grouping ■ pj*, 

equal power products (pV ‘p*‘). In the more general 

case we can let Tpp...pT. represent the ^ different power products 

having the same complete order, pi^ • • • p,"- We may represent any one of 
these forms having this complete order by 



{qiqzQi • . • 

Qp) 

where 

+ ft -b 

ft + ‘ + ft = 

or by 



where 

T ft ®2 "b ■ ' ' "b ~ 

and 

ii "b 3^2 “b 

... _|_ a;, = p. 


there are 




c. SymvietTic Functions. Both the power sum and the power product are 
symmetric functions of the variates since the interchange of any »,■ with any Xj 
does not change the value of the function. Also the powder product having 
p parts is composed of products of powers since the first group of equal 
i’s may be selected in N ways, the next group in iV - 1 ways etc. 


d. Monomial Symmetric Function. It is customary to use the monomial 
symmetric function which is defined as 

22 


* “It was intended that the letter representing the exponents of the g's should be the 
Greek 'chi,' and not the English ‘x."’ 
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and which we designate by M(gi •••?,) or by M{qV ■ • • ??'). This function 
is not useful for our purposes since the number of terms in its expansion varies 
with the number of repeated q’s. For example if K == 3 and N ga; Af (gigi) 
=» + *''4* + xVxV = (giga) 

while if = gj = g 

+ 44 + 44 = 

The monomial symmetric function keeps the number of product terms a 
minimum by eliminating all repeated terms while the power product sum 
keeps the number of product terms the same by the use of repeated terms, 
when some of the parts are alike. 

12. The Formula Connecting (gt'g^ ••• g*0 and M(qV g?')' The 
power product is composed of products, each of which is repeated x\xi\ 

■ • - scj ! times. The monomial symmetric function is composed of the "i^'f . "j. j 

different products which, when repeated Xi ! r* ! • • • a;* I times, gives the terms 
above. Hence 

(gf . . . qV) = xilxj! • . • xd • • • qV) {8} 

In the special case in which gi = 1 and iCi =» p 

aO-plAi'd'’) and JW(n = ^ {10} 

p! 

The function, Af(l'’) is commonly called an elementary symmetric function. 
We refer to the corresponding (I') as the unitary power product sum. 

13. Correspondence of Partitions and Power Products. To each power 
product {qV . . . qV) there corresponds an algebraic partition g? • • • qV having 
p parts and weight = Pi + oa -f • • • + Or . 

This follows at- once from the definHions and notation. Thus if tp = ai 
+ cia + Os , the power product 

E 4i4;4:= E 4i'^‘4; = (5rT^.(i,) 

is, by notation, associated with the partition at -f . Conversely each 
algebraic partition, when enclosed in parentheses, represents a power product 
lium. 

This proposition is useful in that it enables one to establish a relationship 
between the theory of power product sums and the theory of partitions. Earlier 
writers have used a similar correspondence in relating the theory of monomial 



COMBINED EXPANSIONS 


15 


symmetric functions to that of partitions. See for instance [3; 106], [4; 6] 
[5; I; 7]. 

Due to this correspondence we do not hesitate to apply such terms as part, 
order, complete order, similar, etc. to the power product as well as to the 
algebraic partition. Also the sum of all power products (?*' • • • qV) having 
the same complete order is represented by T(pi^ ■ • . p^'). This represents 

/ r 

the sum of ( 

\pi ■ • • p 


similar power products. 


14. The Multiplication Theorem for Power Sums. The correspondence 
property enables us to derive a theorem, to be known as the multiplication 
theorem, which expresses products of power sums in terms of power products. 
The type of argument is introduced by establishing simple cases of the theorem 


MM = 


ZxV.x?, 


= Z +. Z Xi'ji' - (a, + Os) + (aiOj) 

ti—tj t^tj 


ti.is.ti 


= (ui + fl2 4" Oj) + (oi + 02 ’Oi) ■)■ (oi + Os*a2)'"l“ (orflad- Os) 4" (oi>C!2*03) 
since the value 2 broken into 

E . . 2 , . 2 , Z , Z . 

In general, when r ^ N 

iat){(h) . . . (or) = 2 414^ • • • aCir 


and this can be broken into summations featuring different equality relations. 
These summations, define all the different power product sums of weight w = ai 
4- Oj! 4- • ■ • 4“ . The different algebraic partitions of ai 4* 02 4" 4* • ■ ■ 4* 

correspond to the different power product sums. It follows at once that the 
value of (oi)(a 2 ) • • ■ (or) is obtained by writing each algebraic partition of 
oi 4 - 02 -|- • ■ • 4 * Or , enclosing it in parentheses to represent a power product, 
and adding. More S 3 rmboIically we have 

(ai)(a2) . • ■ (cr) = 2 (^i‘ • • • ?‘0 ill} 


where • • • qV represents any algebraic partition of Ci 4 - 02 4 - • • • 4 - a, . 
and the summation holds for all such partitions or by 

••■(«,) = £ TW‘ ■ ■ ■ ?.'■) 1 12| 

where !r(pC ■ ■ ■ p.’*) represents the [ ,4 r. I similar power products and 

\Pl ’ ’ * Pa / 

the summation holds for each different complete order. 
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For example (oi)(«2)(o3) — ?’(3) 4~ ^(21 ) -|- ^0 -^0 

and T( 3 ) = (ai + 02 + <13), ^( 21 ) = (oi -j- oz'^s) -f (ui + 03-02) + (oj 03- Oi), 

and ^(lll) = (oi-oj-os). ^ at Tr i. 

The theorem has been established on the assumption that r g iV . If such 
is not the case it is possible to satisfy the assumption by adding additional 
variates, rKy+i , , • • • a:. , all 0, without changing the value of the power 

sums or of the product of the power sums since the added terms are always 0. 
Thus ■ 

(4 + »2)(a:i + a:2)(®J + icD = + 3:2 + a;?)(xi + a;2 + a;8)(a:i + a;2 + a:D 

when 0:3 = 0 

Then 

(a)(fe)(c) = (a + ^ + <^) d" + t) • c) + (a + c-h) ■+• (& + c-a) + (o-b-c) 


which is 


Ea:f'’‘^' + Ea:f'4 + 

* 


E + S + . E ^U]xl 

i\j i\i\k 


The term E = 0 since every product composing it contains an X 3 = 0. 

i\i\k 

The other power product sums are to be applied to the original variates only 
since the terms involving xs are 0 in every case. 

In general, if r > iV", it is only necessary to write out the power product 
sums having N or less parts since all those having more than iV parts will be 0. 

i 15. The Multiplication Theorem Using the Results of Chapter 1 . Com- 
parison of {12} with {4} shows that {12} can be obtained from {4} by placing 
P(ai ■ • * Or) = (aiXad ■ • • (or), Tpp...pP = T(pi^ • • • pi') and Pp\i...p':> == 1. 
Since this can be done for all values of a and r it follows at once that the entire 
theory of Chapter I is applicable to the present problem. For example Table I 
shows that 


P(321) = P 36 4- P2i51 + P2i 42 + P„33 + Pm 321 
and it follows that 

. (3)(2)(1) = ( 6 ) + (61) + (42) 4 - (33) 4- (321) 

It should be noted that it is possible to use the table previously published 
119; 29-32] since the entries in this table are the values obtained when 
P pIi.. . pp = 1. The value (3)(2)(1) may also be checked from this table. 

16. The Multinomial Theorem. The multinomial theorem is a special case 
of the multiplication theorem for power sums in which the power sums are all 
equal. If ai = 02 = • . . = = 1 , 
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and {12} becomes 


(i)' = 



• vl‘) 


| 13 | 


which is the multinomial theorem in terms of power product sums. Special 
cases are 

( 1 )^ = ( 2 ) + ( 11 ) 

( 1 )* = ( 3 ) + 3 ( 21 ) + ( 111 ) 

( 1 )‘ = ( 4 ) + 4(311 + 3 ( 22 ) + 6 ( 211 ) + ( 1111 ) 


etc. 


The result of {13} may also be obtained immediately from {3} by placing 
P(T) = (I)’’, Ppp...p;. = 1, and pP • • ■ vl' = * ■; vV). _ 

A more general form of the multinomial theorem is that in which = 02 
= , . . = 0 , = a. In this case 

{xi Xi * 4" x%) = (a) 

and {12} gives 

(a)' = E ■ • ■ (aP»)"') { 14} 

where ((api)’^* • ■ • (ap,y’) has parts api , • • ■ , ap, . Thus 
(fl)^ = (3a) 4 - 3(2a'a) 4 - (a^) 

so that 

( 2 )® = ( 6 ) 3(4.2) + ( 2 ^). 

The result {14} may also be obtained immediately from {3'} by placing P(a'') 
= («)'j = 1) and (api)’"’- •• ■ (ap,)*' = ((apiY^ . . • {ap,Y‘). When 

N = 2, {13} gives the binomial theorem 



special cases of which are 

(1)' = (2) 4- (11) 

( 1 )“ = ( 3 ) + 3 ( 21 ) 

( 1 )‘ = ( 4 ) + 4 ( 31 ) + 3 ( 22 ) 
( 1 )‘ = ( 6 ) + 5 ( 41 ) + 10 ( 32 ) 


etc. 
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These can be readily translated to the usual form. Thus 

(a -f- 6)' = a' + b' + + h^a) + + b"a“). 

In a similar manner the trinomial theorem appears as 

A special case of the multinomial theorem {13} is also useful in writing N' 
in terms of sums of When the variates are all unity the power sums are 
all N, and the power product sums are the number of terms in the partition 
representing it. If a partition has p parts the number of terms in it is N^‘‘\ 
We then have 



Special cases are 
A' = j\r + 
j\r’ = iv + 3JV"’ + 

A* = = N + + jV^‘^ 

etc. 


17, The Use of Monomial Symmetric Functions. It is possible to express 
the results in terms of the monomial symmetric functions by means of (8}. 
Thus 

(2)(2)(2) = (6) -f 3(42) + (222) 

= JW(6) + 3M(42) + 6Af(222). 


In general, Table I may be used to express products of power sums in terms 
of monomial symmetric functions. It is only necessary to place every Ppp . . .pji 
= 1 and to multiply by the factorials indicating the repeated entries at the 
head of each column. The table [19; 29-32] may be used similarly. 

The multinomial theorem in terms Of monomial symmetric functions becomes 


(O' - E Tikz! • . . T.iMipr • • • pro 


and by {1| 


(1)' = z 


r! 


as it is conventionally stated. 


|16| 
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18. The Multiplication Theorem from the Multinomial Theorem, It is 

possible to use generalization from symmetry in deriving the multiplication 
theorem from the multinomial theorem though this can not well he done from 
its conventional statement (16). The monomial symmetric function does not 
have the property that M(a-6) - Mia- a) when 6 = a while (a- 5) does become 
(a- a) when h = a/ The first step then is to reduce |16| to power product 
sums by means of {9}. We then have 


(1)' - E 


r! 


* ■ ' (PsO’’* • • • TTj! 


(pi 


Next it is necessary to introduce the factor ^ for there are many 
equal terms for each value pj"' when the a's are all unity. This is very 

easy in this ease since the value of the coefficient of • • • p' ') is ( » i ^ » , J 

\Pi • • • p, /. . 

It follows at once that 


(ir = i: 


.pi 


Vt 




Suppose that the r units are replaced by oiOj • ■ . Cr . Then the f ^ t, ) 

\Pi ' ' * pi / 

power products, (pV ■ • • pf') will be replaced by the I ,, », ) different 

power products composing T(pi^ * • * pJO- It follows at once that 

(ai)(a2) ■ ■ ■ (ttr) = E • ' • P"0- 


19. The Detenninatioii of the Coefficient of a Given Power Product in the 
Expansion of a Product of Power Sums. In some cases we wish to determine 
the coefficient of a given power product without computing the complete 

1 ) where the P coefficients are unity. 
Thus the coefficient of (32) in the expansion of (2)(1)(1)(1) is found from 
P (^ 32 ^) - Psi + 3P22 and is 4. 

20. Relation to Previous Results. The multiplication theorem may be 
viewed as a generalization of the multinomial theorem. A more general proof, 
applicable to multivariate problems, could be presented with the use of more 
involved notation. It seems wise rather to present the simpler one variate 
case and to emphasize the principle of generalization from symmetry which 
will enable us to write the multivariate laws with relative ease. 

The general problem discussed here seems to have received a very small 
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amount of consideration as much of the extensive classieal theory of sym- 
metric functions is limited to the interrelations of the elementary symmetric 
functions and the monomial symmetric functions. 

A monumental work on symmetric functions not subject to this limitation 
is the Combinatory Analysis of MacMahon [iC], MacMahon provided a 
technique for multiplying power sums in many variables as a special case of a 
more general theory. [K; II, 321], 

Some of the work on alternants is closely related to the problem of products 
of power sums although the alternant, as usually defined, is limited to the case 
in which r =: JV [I; 11, 446]. For an example the reader is referred to a devel- 
opment by Muir [L; SSS-fi). 

Thiele (1889) gave tables^ of products of power sums in terms of monomial 
symmetric functions for partition products of weight ^8 [H; 114-117], J. R. 
Roe has later given one for uj g 10 [N ; Plates 17, 18]. Statisticians have some- 
times stated the results in nontabular form. See for example, the multipli- 
cation formulas of Church [13; 81-83] [14; 370-1], whose results may not at 
first appear to agree with those above since Church has used a less compact 
notation and, of course, the monomial symmetric function. 

The cKief contributions of the present attack are 

1. The use of the formulas and tables of Chapter I in writing expansions of 
products of power sums. 

2. The use of power product sums in place of monomial symmetric functions 
which makes feasible. 

3. GeneralizationTrom symmetry. 

Chapter III 

It is the purpose of this chapter to establish formulas giving the expansion 
of power products in terms of products of power sums. 

21, The Binet (Waring) Identities. It is customary to introduce this subject 
with formulas for M{a-h), M(a-b-c), etc. so we first derive the formulas for 
(a*b), (c'b'c), etc. We may use the results of Chapter II since the problem 
here is the inverse of the multiplication problem. By the multiplication 
theorem 

(a)(5) = (a b) -f (a-6) 

(a)(5)(c) s= (a 4- 1) -j- c) 4- (o + h-c} 4- (^^ 4* C'h) 4“ (h 4" c-a) 4- (a-b-c) 

(a 4- fc)(c) « (g 4- 6 4- c) 4 - {aTb^c) 


^Theee tables are not accessible to me, but Thiele refers to them in his “Theory of 
Observations." *** wx 
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SO we get 

(a-fe) = ■— (fl + ^) 

(a b-c) = (a)(b)(c) — (a + b)(c) — (a 4- c)(?)) — (6 -f c)(a) 

4- 2(a 4- b 4- c) 

Similarly 

(a.&.cd) = (a)(b)(c)(ci) - (a 4- bXc)(d) ~ (a + c)(bXd) 

- (a + dXbX^) - (& 4- c)(a)(d) - (6 4- rf)(a)(c) 

"—( 04 * ^)(^)(^) — ”l~ "t" “ (ct 4“ 4“ d) 

— (0 4" dXb 4" c) 4* 2(0 4* ^ 4“ 4~ 2(o 4“ 4~ ^)(^) 

4“ 2(0 4" ^ 4” 4“ 4" 4” — 6(<i 4" ^ “I" ^ 4“ 

{19} 

When a ^ b N c ^ rf, {18}, [19}, (20) are also the formulas iovM{db), M(ahc), 
Miahcd). These formulas are quite commonly attributed to Binet who gave 
them in 1812 in connection with certain proofs of determinant theory [1 ; 284] 
[I; I; 81]. Waring should be given credit (see Miscellanea Analytica 1762). 
Binet gave no proof. The reader is also referred to the earlier work of Paoli 
[A; section 28). 

A much more adequate treatment was given by Hirsch in the early 19th 
century [B; 35-38]. He wrote, out the terms for Jlf(a'b>c*d'e) and indicated 
a scheme for extending the results. More than this he proved that any "numeri- 
cal expression” — ^his term for monomial symmetric function — can be reduced 
to numerical expression having one less part [B ; 26]. The continued application 
of this theorem leads eventually to numerical expressions having only one part, 
i.e. to power sums. Hence all numerical expressions can he reduced to power 
sums [B; 27, 32], 

Recent authors give essentially the same proof. See for example Bocher 
[J ; 241-242] who states the theorem, “Every symmetric polynomial is a linear 
combination with constant coefficients of a certain number of the S’s*.” See 
also O’Toole [16; 114] and Burnside and Panton [E; 167]. Thusraodern authors 
provide a proof of the fact that M{ai ■ • • ar) can be expanded in terms of power 
sums but most of them fail to provide a formula giving this precise expansion. 
Even MacMahon after writing the values of M(Xm), M{\nr), M{}^^), M(X*) 
avoids the immediate generalization by stating [K; I; 7], “in actual practice 
there are easier ways of calculating the many part functions and the general 
formula is of little importance.” 

While MacMahoii’s statement has a certain amount of truth in that any 
given monomial symmetric function may be computed from others having one 
less part by the recursion property described by Hirsch, yet there are many 
cases in which a definite formula, rather than a method, is desirable. A formula 


{17} 

{18} 
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p&rticulflxly is d6iD.&nd6d by ths stEtisticisn who is working with & numbGr 
of monomial symmetric functions simultaneously. See for example the remarks 
and efforts of Carver [15; 103-104, 119-120], Church [14; 373, 377-378], and 
O'Toole [16; 115]. 

Some authors have provided solutions and it appears that statisticians are 
not entirely familiar with all the work which has previously been done. It 
is the aim of the remainder of this chapter to suggest references which make 
previous work available to statisticians as well as to present a logical and quite 
complete development. The main results are not essentially new although 
their explicit statement in the language of power products is necessary for the 
development of the next chapter. The argument features the easy generaliza- 
tion from symmetry. The value of (f) is expressed in such a form that the 
value (fli • • • Or) may be obtained immediately from it. 


22. The Value of (r) from Waring’s Expansion for the Elementary Sym- 
metric Function. We first derive the formula (!’') from the conventional 
Waring’s expression for pm i*i terms of the power sums. Burnside and Panton 
[E; II; 92] give this as 



r(ri -b 1) r(r* 4- 1) • • • r(r„. 4- 1) 2''» 3^» • • • m’’’" 


120| 


where and where /SI' * ■ • 5^” is any n 4- rj 4- • ■ • 4- r„ 

part partition of w. When wi = r and pf ‘ • • • pj* is any p part partition of m, 
[20 1 becomes 


(-i)'M(r) = I ■■(?■)'• 

Pi' ' * ' ' p»! ’ 7ri!x2l ♦ ' • 7r,l 

Dividing by (-1)'' and noting that (-I)''"’’ == (-1)""'’ we have 


M(n = y (-lyfar ■■■fa) 


p,!'* iri!7r2! • • • ir,! 


and hence that 


( 21 ! 


( 22 | 


(r) = riMco =. 2;fafa~'’''fa)''' ■■■ fa) 


pi'." • ' ■ pdT’TTil-ira’- ■ • • TT,! 


{23} 


k second proof of [23], given in the next sections, does not assume the 
formula [20] and develops by easy stages. Although somewhat longer than 
the method above, it contacts much of the work that has been done in this 
field. It also provides two useful arithmetic checks dealing with the coeffi- 
cients which the more analytic method above does not provide. Those who are 
familar with {20} above and are interested in the immediate development of the 
argument with the use of j23) should turn to the equivalent (38} of section 28. 
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23. The Newtonian Formulas. The development begins with the well 
known formulas connecting the power sums and the elementary symmetric 
functions which appeared in Newton's Arithmetica Universalis. These formu- 
las are given by Bocher (J ; 244) as follows 

... + (-!)>. = 0 4 = 1,2, 1241 

where Sk is the sum of the fc-th powers and p is the f-th elementary symmetric 
function. 

So many proofs of this theorem are accessible that a repetition here is hardly 
justifiable. A proof using calculus was given by Bocher (J; 243). Proofs 
using algebra only were given by Hirsch (B; 16) and Chrystal (F; I, 437). 
Muirhead (9; 66-70) gave three proofs of which the second is perhaps best 
adapted to the present development. 

24. The Detenninant Equivalent of (T). It is usual to solve the Newtonian 
equations for the power sums (J; 244) but our objective is the solution in terms 


of the power sums. The equations are 


Pi 


= (1) 

(l)pi - 

“ 2p2 

= (2) 

(2)p2 - 

- (1)P2 + 3p3 

= (3) 

(3)pi - 

- (2)P2 -f- (1)P3 - 

- 4p4 = (4) 


whence 


1 0 

0 


0 

(1) 

(1) -2 

0 


0 

(2) 

(2) -(1) 

3 


0 

(3) 

1 

1 

1 

SXr- 

4) 

(-irv-1) 

(^-1) 

! 

1 

1 

2)(r- 

3) 

(-mi) 

(r) 

1 0 

0 


0 

0 

(1) -2 

0 


0 

0 

(2) -(1) 

3 


0 

0 

1 

to 

I 

! 

3)(r- 

4) 

(-irv-i) 

0 

1 (r — 1) — (r — 

2)(r- 

3) 

(-mi) 

(-m 


Next, factor out all the negative signs in the even numbered columns in each 
determinant. The number of these columns of negative signs is the same as 
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the number in the denominator if r is odd. If r is even, there m one more in 
the denominator. Hence the negative signs may be dropped in both deter- 
minants if {-l)''“^'is inserted in the numerator. Furthermore the value of 
the determinant in the denominator is r! Next, change the numerator by 
moving the r-th column to the first column position and inserting the com- 
pensating factor ( - ir\ If Ar represents the resulting numerator determinant, 
the value of pr becomes 


and 

We have then 

(f) = A, = 


A, = r!pr = (r)‘ 


(1) 

1 0 

0 

0 

(2) 

(1) 2 

0 

0 

(3) 

(3) (1) 

0 

0 

(r - 

1) ()■ - 2) (r - 3) 

(1) 

r — 1 

(r) 

(r - 1) (r - 2) 

(2) 

(1) 


[25} 


The determinant has received the attention of earlier writers {19; 3}. Gen- 
eralizations of it will be mentioned at the close of the chapter. Its expansion 
in terms of power sums is known and may be written 


^ - V ■■■(v.y 

' pj’Ti . . . PjI’T) ttiItts! • • • itj! 

where PiTn -f- piirz = r 


{26} 


and 


• • • + VTs = p. 


See for example O’Toole (16; 113). 

It is at once evident that {26} is equivalent to {23}.. Those who are familiar 
with the expansion of A,, above may wish to turn immediately to {38} of sec- 
tion 28 since the intervening sections are devoted to a rather detailed and rigor- 
ous expansion of the determinant. This development follows, in a general way, 
that given by Mola (5; 190-195). 

25. The Expansion of (T) = A^. The determinant, A^, is a special type 
of determinant which is known as a recurrent. There is a simple recursion 
property which is useful in its expansions in terms of products of power sums. 
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(1) 

1 

0 


0 

0 


(2) 

(1) 

2 


0 

0 

Ar+1 = 

(3) 

(2) 

(1) 



0 

0 


(r) 

(r - 

l)(r- 

2) 

(1) 

r 


(r + 1) (r) 

(r - 

1) 

(2) 

(1) 

If we expand Ar 

+1 ill 

terms of 

the (r + 

l)st column we have 



= (1)A, - rAr {27} 

where A, represents the determinant A, with every power sum in the r-th row 
increased by unity. It is only necessary to arrive at some method of designat- 
ing these terms if the above recurrence formula is to be applied. This can be 
done by inserting the power sum (1) before the other power sums which it is 
to multiply. Also in forming A, add unity to the first power sums in the expan- 
sion of Ar being careful to retain the previous order. Thus 

Ai = (1) 

A: - (1)(1) - 1(1 + 1) = (l)(l) - (2) 

A. = (1)[(I)(1) - (2)] - 2[(2)(1) - (3)1 = (1)(1)(1) - (1)(2) 

- 2(2)(1) + 2(3) 

A, = (1)(1)(1)(1) - (1)(1)(2) - 2(1)(2)(1) + 2(1)(3) - 3(2)(1)(1) 

+3(2)(2) + 6(3)(1) - 6(4) | {281 

A. = (1)(1)(1)(1)(1) - (1)(1)(1)(2) _ 2(1)(1)(2)(1) + 2(1)(1)(3) 
-3(1)(2)(1)(1) + 3(1)(2)(2) + 6(1)(3)(1) - 6(1)(4) 

- 4(2)(1)(1)(1) + 4(2)(1)(2) + 8(2)(2)(1) - 8(2)(3) 

+ 12(3)(1)(1) - 12(3)(2) - 24(4)(1) + 24(6) 

etc. 

By eolledion of repeated terms and recalling that (1') = A, , the expansion 
becomes 

(1) = (1) 1 
(C) = (1)’ - (2) 

(1*) = (!)• - 3(2)(1) + 2(3) 

(1‘) = (1)‘ - 6(2)0)' + 3(2)' + 8(3)(1) - 6(4) ■ f29| 

(1‘) = (!)■ _ 10(2)(1)“ + 16(2)(2)(1) + 20(3)(1)(1) - 20(3)(2) 
-30(4)(1) + 24(6). 
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It is possible to write values of (r) in terms of power sums though the practical 
difficulty increases as t increases. Also continued use of the recursion formula 
(27 \ is apt to lead to error. Two simple checks are available, If Dr represents 
the sum of the coefficients of the expansion of (I") and ) 1 represents the sum 

of the absolute values of these coefficients, then 

D, s= 0 when r > 1 {30} 

1 Dr 1 = r! {31} 

The proof of {30} and {31} follows directly from {27} since the coefficients 
of Arand Arare the same. Thus Dr+i = (1 — r)Dr and { Dr+i\ = (1 -f r)| Dr {. 
Since Dj = 0 it follows that Ds , D 4 , • • • , Dr = 0 and since {Dal = 2 ! it fol- 
lows that 1 D, 1, 1 D 4 1, • • • , 1 Dr 1 are 31, 4!, rl respectively. 

26. Detennination of the Coefficient of Any Ordered Product of Power Sums 
in. the Scansion of Ar . We next attempt to revise the process outlined above 
so as to get the formulas {29} without going through the work of writing out 
{28}. We note first that every product of power sums in the expansion of 
(!'■) in {28} has been obtained from (l) by a succession of r — 1 operations 
which were either prefixes (when the (1) was prefixed) or raises (when the (1) 
was added). Also the order of the power sums in a given term indicates which 
operations have been prefixes and which raises. For example (l)(l)(l)(l)(l) 
results from 4 prefixes while (5) results from 4 raises. The term (3)(2) results 
from 1 raise, 1 prefix, and 2 raises respectively, while the term (2) (3) results 
from 2 raises, a prefix, and a raise, . The product (pi)(p 8 )(?> 2 )(pi) results from 
prefixes when r - pi, r = Pi Jh , r = Pi 4- Pa Pa and raises at all other 
times. 

The sign of the coefficient of (p 4 )(p 3 )(p 2 )(pi) can be determined when we 
recall that each raise is accompanied by a multiplication by — r while each 
prefix is accompanied by no change in the coefficient. There have been pi — 1 
4 Pj - 1 + pa -• 1 -f p* — 1 = Pi 4- Pa + p 3 4- — 4 raises so the sign 

13 (“'4)’^^ where pi 4 - 4 P» 4 P* = More generally if (pp) • • • (p 3 )(ps)(pi) 

is a term in the expansion of (F) where pp 4 - • • • + Ps 4 - Pa .-f pi ~ the 
number of changes in the sign ispi-l-j-pa — 14 .... =spj 4 -p, 

+ ■ • ■ 4- Pio — P = r — p. It follows at once that those products of power 
sums in the expansion of (T) which have the same number of factors, p, also 
have the same sign and that this sign is (~l)'~^ 

In determining the numerical part of the coefficient we note that each prefix 

is accompanied by a multiplication by unity which can be written in the form - . 

r 

Each raise is accbmpanied by a multiplication by r so there appears in the 
numerator the product of all possible values of r and in the denominator the 
product of those values of r corresponding to each prefix. For example the 
numerical coefficient of is 
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(p4 + Pa + Pz +• yi — 1) ! _ (p4 + Pa + P2 + Pi) 1 

(pa + p 2 + Pi)(p 2 + Pi)(Pi) (P4 + Pa + P 2 + pi)(P3 4- Pz + Pl)(P 2 + Pl)(Pl) 

Similarly the coefficient, without sign of (p„)(pp-i), • • • (pj)(p 2 )(pi) in the 
expansion of (r) is 

iVp + Pp-i + • • • + Pa 4- P2 4- Pi)i (321 

(Pp + Pp-i + • ■ • + Pa + P 2 + pi)(Pp-x + * • ' 

+ Pa +P 2 + Pi) " • (Ps + P 2 + pi)(p 2 4- Pi)(pi) 

The denominator of {32} has a certain resemblance to a factorial. Thus 
41 = (1 4- 1 4- 1 + 1) (1 4“ 1 4- 1) (1 4- 1) (1) in which the successive factors 
are found by dropping the first unit. The corresponding algebraic expression 
(P4 4- Pa 4- P* + pO (Ps 4- Ps 4- Pi) Cp: 4- Pi) (Pi) is found in the same way 
and might be called an “algebraic factorial.” It might be designated by 

(Pi 4“ 4" Pa 4" Pi)l 

It should be noted that the order of the terms in the algebraic factorial is sig- 
nificant. Thus (ps 4- Pi)i ^ (Pi 4- Pa)! unless pi - ps . 

The coefficient of (pp)(pp-i) • ■ ■ (p2)(pi) in the expansion of (r) may now 
be written 




(Pp 4- h p2 + Pi)i 


For example the coefficient 


(2)(lX2)fe(-irj-iL„4 
(l)(2X2)is(-l)‘-’j^ = 3 


1331 


(2X2Xl)iB(-l)'^^j-8 

and the total coefficient of all terms involving (2)(2)(1) is 15. 

With a less formal notation we might designate the sum of the p! “algebraic 
factorials” which can be formed from p, , • p 2 , pi by 

S (pp 4- Pp-i 4- • • • 4“ Pa + Pi)i 
and the sum of their reciprocals by 


s 


1 _ 

(Pp 4- Pp-1 + • ’ • 4- P2 4- Pi)l 


This notation calls for the inclusion of all the p ! algebraic factorials even though 
some of them may be alike. If 


TTl f TTj ; ■ * * j 
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indicate the numbers of repeated p’s 
^ 1 


(.V? + Po-i + 


where holds for the 


+ P2 + Pi)i 
— ttiItts! • • 
r! 


TTi 




(Pp + pp^t + • • • + P2 + Pl)l 

non-repeated terms. 


{341 


TrilTTj! • * • Tj! 

In general the total coefficient of (pOCpa) • • • (Pp) in the expansion 
of (X) is obtained by adding all possible terms (331 in which the same p’s 
occur in different positions in the product. Every possible different position 
grouping of the p’s is present but once since it is dependent solely on the unique 
order in which prefixes and raises have been combined to produce that particular 
position grouping. The number of these position groupings varies with the 
number of repeated p’s. The sum of the coefficients of these position groupings 
of the same p’s, i.e. the total coefficient of (,pi)(pi) > • < (pp) is then given by 

(-irvii:' 


(Pp H + Pi)i 


which can be written by means of {34} 

r! 


(-ir 


I ! 'TTo! 


TTiJtTj! * • * TTg 

The formula for ( 1 ) may be written 
rl 


(?»+■■■+ P>)I ' 


(i') = E(-ir' 


viIttzI • • • tt,! (Pp + ‘ + pi)i 


; (pi)(p 2 ) • • • (pp) {36} 


27. Theorem on Algebraic Factorials. The result {35} can be further 
simplified by the theorem 


1 


(Pp + ■ ■ • + p^ + Pi)l VpPp-i • • ■ piPi 

which is proved by mathematical induction. 

A. It is true when p = 2, since 


{36} 


J_ + ^ fi . 1 ] == JL 

+ Pi)l (Pi + P2)l Pi + Pi LPi pij Pipa 


(P2 + Pl)i {Pi + 

B. If it is true for p = k, it is true for p = 4 . 1 since 


1 


(p*+i + p* + 


+ P2 + pOi 
1 


[2 


Pfc+i + • • ■ + Pa + Pi L (P* H + Pi)i 

+ Es: 


Pil+1 ivk + Pk-1 + • ■ • +Pi)i. 
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where ^ gives the h terms in which pk+i replaces pk, pk-i, P 2 , Pi re- 

pi+i 

spectively. Now if {36} is true when p - k 

1 __ 1 Pk Pk-1 ‘ ' ~l~ P2 4" 7-*^ 

^ (PHI + ' • • + Pi)] ~ Pi+i-i + Pi L VwVkVk-i • ’ ‘ V2Vl 


PkJriVkVk-l • ’ ‘ V2Pl 


Vk^m ' • • V2Pl 

C. Hence it is true when k = 2, 3, i ••• . 

28. Formulas for (r). Formula {35} may now be written 

(10 = E • • ■ W 1371 

TTi! • • • ir,\ piPi Pp 

or if the p’s are ordered it may be wr^itten as 

(!') = E (-!)'■' -r "' — I ^ .n- 1 ^®! 

ITli • TTiJ Pi ■ • • p, 

which is the formula previously given as {23} and (26}. In addition the check 
formulas {30} and {31} become 

E C-l)"' j - 0 (391 

= (40) 

Pi < p, iTi! ••• 7r,I 

These relations {39} and {40} correspond to statements of Cauchy (2), (I; i; 
252-3) and to later remarks of Cayley (D ; 677). By dividing by rl, they become 

E >. — , = 0 («i 

E-th — r^—i i-i {42}. 

Pi ■ • • p, TTil • • • T.l ‘ ’ 

The formula {38} is easily applied. Thus 

(1‘) = I (5) - f (4)(1) - I (3)(2) + 3^, (3)(1)- + (2«1) 

- I-I 

= 24(6) - 30(4)(1) - 20(3)(2) + 20(3)(1)' + 15(2)*(l) 

- 10(2)(1)* + (l)^ 


24 - 30 - 20 4- 20 + 15 - 10 -b 1 = 0 
24 4 30 4 29 + 20 4 15 4 10 + 1 = 5! 
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We next write the formula (10 in such form that we use the principle of 
generalization from symmetry. If we multiply numerator and denominator 
of {38) by (pi ~ 1) r(p 2 -!)!'“••• (P. - 1) we get 




• ’ * (PJ)’'* TTil • • • TT, 


which immediately becomes 


(?.)'■■■■(?.)" 143). 


This somewhat formidable appearing formula is easy to apply. For example, 
in finding the value of (1®) we write in one row all possible partitions of 5. 

In the next. row we place the well known values of ( ,, ^ r,). In the next 

\Pi ■■•p.7 

row we place the indicated products with proper signs. Thus 



21® 

2*1 

31* 

32 

41 

6 

1 

10 

16 

10 

10 

6 

1 

1 

-1 

"{"I 

+2 

^2 

~6 

-1-24 


results in 

(lO = (ly _ 10(2)(iy + 15(2)Xl) + 20(3)(iy - 20(3)(2) 

- 30(4)(1) + 24(5) 

as indicated above. 

It is immediately recognized that formula {43} can be obtained from for- 
mula {3} by placing P(r) = (!");?[* •••?>»'* by (pi)'‘ • • • (pd** uud 
by -- 1)1'‘ ••• (pi - 1)!'* and hence that formulas of Table I 

may be used in obtaining the values of (F). 


29. Values of (oi ••• ffir). The form of {43} also permits generalization 
from symmetry since the ^ equal values (pi)’^‘ ■ • ■ (ptY’ are re- 
placed by the ^ different values composing !r(pi)'^ • • ■ (jo,)** when 
the r units are replaced by the a’s. It follows at once that 
Wa, ... a,) = - i)p ... (p. _ l)r*!r(p0'^ ... (p.)"* (44} 


where 

and 


'l' — PlTTl -f PiTs -f. ■ . , -j- p,T, 

P = TTl -i- Tfj -f . . . TT, . 
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As an illustration we write 

(a6c) = 2(a -j- & + c) ~ (a 4- — (ct + c)(6) — (b + c)(a) 

+ (.a)0>)ic) 

as indicated earlier by {18] and 

(W.a4) = - 6J’(d) + 25’(3)(1) + r(2)(2) - 2’(2)(1)' + 7(1)* 

(wflA) - 24T(5) - 6T(4)(1) - 23’(3)(2) + 2T(3)(1)’ 

+ 3'(2)’(1) - r(2)(l)’ + I’d)* 

etc. 

30. Table of Values of (ai • • • flr). The values of the power products with 
•«j ^ 6 are given in Table II which follows the general form of Table I. In 
fact Table II may be derived from Table I by placing every 

as indicated in the next section. 


31. Use of Partition Formulas. By comparing {44} with {4} we see that 
[44} can be obtained from [4} by placing 

P(aia2 • * . tta) = (aiOz • • • a^) 

P,Ti...,T. = (- inCpi- l)r ... (p. -i)r* 

and = Tip^Y^ ... {p,y‘ 

It appears then that the values of any power product sum (fliOi ... flr) can 
be obtained by writing the expansion of P(ai * • • ar) and substituting as indi- 
cated. Thus since 

P(321) = P 36 + P2i 51 -b P2 i 42 + Pj^SS -b Pm 111 
(321) « 2(6) - (6)(1) - (4)(2) - (3)(3) -b (1)(1)(1). 


It is also immediately apparent that Table II can be obtained from Table I 
by placing Ppp,.,pj. equal to (— l)’^''^(pi — 1) < (p, -- 1)!'* and that the 
main results of Chapter I, including the recursion rule, are applicable to the 
present problem. 


32. Coefficients of Given Terms in the Expansion of Product Power Sums. 

The methods of the last section are also useful in finding the coefficient of any 
term in the expansion. For example we wish to find the coefficient of (3) (2) 


in the expansion of (2111). We note that P| 


211l\ 
32 ) 


= P31 + 3P22 and that 
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TABLE II 

Pffwer product mm in terms oj prodmts oj power sums when W ^ 6 
W = 6 



the coeffi^ent of (3)(2) is Ai + SPu where Psi = (- 1)*“’'2! = 2 and Pss 
= (_ 1]* ^ = 1 . Hence the coefficient isl'2“|-3*l = 5. 


33. The Expansion of the Monomial Symmetric Function. If ai ^ ctj ^ a* 

^ ^ Ur then M(ai ... a,) = (ai ... a,) and previous results are applicable. 

If however the product power sum is of the form 
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then 

and 

M{at' ■■■an 

1 S (_l)'-'(p. - !)!'■ • ■ ■ (p. - !)!’• r(p.)’‘ ■ • ■ I«) 

alias! •• • aftl 

For example 

Jlf(421) = 2(7) - (6)(1) - (5)(2) - (4:)(3) + (4)(2)(1) 

JW(322) = (7) ~ (5)(2) - Ki)(3) + K3)(2)(2). 

M{2Y) = -1(6) + (5)(1) + K4)(2) + K3)(3) - K4)(i)(l) 

- (3)(2)(1) - i(2)(2)(2) + K2)(2)(1)(1). 

Study will show that the formula {45} is equivalent to one given by Fa^ de 
Bruno (C; 9) and later by Roe (7). 

It is possible to use Table II in finding the expansion of the monomial sym- 
metric functions. It is only necessary to multiply each term in tlie expansion 

of (fli . .. ttr) by 1. 

ai! • * * 0*1 

The check formulas give, in the case of the monomial symmetric function; 
The sum of the coefficients in the expansion is 0. 

T ! 

The sum of the absolute values of the coefficients is i . 

ailaj! • ■ • a*! 

The reader might compare the second of these checks with the results of 
Fall de Bruno (0; 14). 

Tables giving the expansion of monomial symmetric function have been 
given. One by J. R. Roe (12; plate 18) includes all cases of weight glO. 

34. Previous Results, Previous authors have studied the monomial sym- 
metric function. Gordan has deduced a monomial symmetric function formula 
which is recommended by J, R. Roe (M; 24^33) . MacMahon has given a 
general formula (K; II; 320) for expanding any monomial symmetric function 
in terms of power sums together with an operational method for its evaluation. 
O’Toole also has given a differential operator and showed how it could be applied 
in obtaining expansions (16; 115-130). O’Toole has also given a method of 
expanding symmetric functions in many variables by means of differential 
operators, (17). 

Another method of attack was based upon the close relation existing between 
the elementary symmetric function and the determinant of the power sums. 
This has resulted in the expression of the monomial symmetric function in 
determinant form. Briosehi appears to have been the first (1854) to see how 
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a symbolic determinant could be used (3; 427) although he gave no proof, 
Bellavites tried in 1857, but obtained incorrect results (4), In 1876 Fatl de 
Bruno made an attempt, but he too was in error (C; 10). In 1898 E, T>, Roo^ Jr. 
proved that Brioschi was right (7). Muir also gave a proof in 1908 (11; 5-9). 
The summation of determinants, rather than the symbolic determinant^ was 
used by Hankel (6; 90-94) (L; III, 220). 

The determinant of the power sums has been generalized in another way. 
A group of writers has studied the '^immanents'^ of its matrix, D. E. Little- 
wood and A. R. Richardson have recently written a series of papers on this 
topic. One of these papers (18; 99‘-141) defined the term ‘‘immanenta” and 
gave references to previous investigations dealing with this matrix. 

It has been the aim of this chapter to present an easy development of the 
subject of the expansion of product power sums and monomial S 3 mimetric func- 
tions. This development is characterized by 

L The use of the formulas and tables of Chapter I in writing expansions of 
product power sums, 

2. The use of product power sums in place of monomial symmetric functions 
which makes feasible 

3. Generalization from symmetry, 

4. References to previous work. 

Chapter IV* The Double Expansion Theorem 

In the present chapter we combine the multiplication expansion of Chapter II 
and the power product mtn expansion of Chapter III into a new result which 
IS to be known as the double expansion theorem- We show that this result 
may also be expressed In terms of the partition notation of Chapter 1. 

35. The Value of X(ai)(o 2 ). We know 

(oi)(ct2) = (tti -f- 02) 4“ (ui’flji) 

»and U we multiply (ai -f oj) by fcj and (aro^) by kn we have a new expression 

which we designate by ii:(a0(a2). 

= h(ai 4^ 02) + Aii(ara2) ( 40 } 

(aioa) = (ai)(as) -.(^-(-02) 

hiai + 02) + fei[(oi)(a 2 ) -- (ax + a^)] 

^(«i)(a2) = (k ^ A;n)(ax + 0 , 2 ) + ku{ai)(ai) 
which can be written 

'^(ai)(a!) = ifj(ai + 04 ) + Jirii(a])(a 2 ) (47) 

if h - ka = K, and ifu = kn 
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36. The Value of Z(ai)(a 2 )(o 3 )- We know from {12) that 

- T(3) + 7(21) + 7(111) 

and we define Jf(ai)(a 2 )(a 8 ) = fe7( 3) + ^ 7(21) + fciii 7(lll). Inser ting 
the values Tz = (ai + Oa H- aa), 721 = (ai + a^^az) + (a\ + ayck) + (^2 + 

Till - (aiOaUa) and reducing to power sums by (44), we get 

^L(o-i)(Q 2 )(a 3 ) = (A?3 ^ d" ^-02 + 03) -f- (fcji — km) 

I (ui + aa)(a3) + (at + + (02 + a3)(ai)) + fou(ai)(a2)(a3) 

which may be written 

= JCziai + (h + as) i- Kfn{(ai + ch)(m) 

4" (^1 "b <^3)(^24) “b ((h + ^3)(®i)} H" •Kui(cti)(<i2)(a3) 1 48) 

where Ks = ks — Sfei + Sfcm ^ iiiai fei — km , Km ~ ftm . 


37. Definition of K(ai)(a^) • • * (ar). We define 

K(ai)(a,) * . . (ar) - Z T(pV - * pJO m 


where T(pP • . ■ p^*) is composed of 



power product suras. 


We 


wish to find the value K{ai){a^) . - (a,) in terms of power sums. This in- 
volves the expansion of each power product sum in terms of power sums and 
then the collection of the results. This algebraic process is to be called the 
double expansion process and the theorem which results, the double expansion 
theorem. 


38. Special Cases of the Theorem. The results {47) and (48) are special 
cases of the double expansion theorem when r = 2, S. When r = 1 it is evident 
that Z(oi) = Jfi(ai) = fci(ai). {50} 

The results {50), {48), and (49) may be written symbolically by 

K(ai) = KiT(l) 

Kiai){a,) - K,T(2) + KiiT(iy {51) 

K(aM(a,) ^ K,T(S) + KnT(2)il) + RmTilf 

It can also be shown, with a much more extensive use of the results of Chapters II 
and III, that' 

iS:{oi)(as)(a3)(a4) = KiT(^) + iC3iT’(3)(l) + KiiT(2f 

+ + •^iiii3'(l)* |62| 

K(at ). . . . (as) « i5:,r(6) + Jf«r(4)(l) + K^T(2)(2) 

+ KmT(3)(iy + lCm7’(2)*(l) + If„„3’(2)(l)* 

+ i^iini?'(I)* [53) 
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where 

Ki^h 

- 4^31 ’ 

" 3^22 4“ 12^251 fi^tm 


\ 



Kn = 

hi 

“'3/c2u 4~ 2?iiiui 





Kis = 


JCii — 2feii + fciu 



M541 


iC!ii = 


km kmx 





Kmi « 


kmi 


1 


and 

Kt = h 

- 6^:41 

— lOfcsa 4" 20^311 4“ 30^^221 

— GOfeui “ri 24^11111 




^41 

4^311 — 3^^221 

4" ISfcjm — 

GAjuiu 



Kn = 


“ ^311 3^221 

4 

4" fifcaui '■' 

2feuni 



Km - 



— 3^ni + 

2A;iuu 

> 1S5) 


Km = 


^221 

— 2^2111 + 

kiini 



■Kim — 



fcaui 

hww 



Kiiiu = 




fcimi ^ 



We iti&y say then that, for r < 6 

iC(ai) ■••(£!,) = £ rCpr* . - • p^‘) 

■■•(p.r [56) 

where Jfpfu,,p;ns defined by the relations {47}, {48}, {54), and j65}» In 
examining the value of Kr we note 


I(i - fci 
jKz ^ 

Jffs = Ic3 — 3^21 2fcm 


Ki — ’ ^J4 — '"h 12^211 ”” fi^jui 

Kh == ^6 10^32 4" 4" 30^Jajl ^ fiOfcaili *4" 24:/ClUU 

and that these are given, for r < 6 by 


Kr=Zi-mP 



k 




(671 


It is further to be noted that jS?) can be obtained from {3} by placing P(l0 
= X, •'* K' by and by (-l/Cp — 1)1 Hence the 

last TOWS of Table I may be used in writing the values of Kr . Thus from 


Pil') - Ps(3) + 3P2 i( 21) + Piu(l)' 
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we get 

^ Jc^ 3ifc^i -|- 2/cm . 

It is further evident that if = (k^ ~ Sfei -j- 2/ciii)(fe - ku) indicates 
multiplication by suffixing of subscripts that JQK 2 = hz - hn - Sfei + Sfem 
^ 2knm “ 

and in general it can be shown that for r < 6 


= Kr,K~K7, jSSl 

etc. 

so that all values may be obtained by symbolic multiplication of 

equations {57). 

The method of this section can be used in demonstrating that the results 
1 56), j57}, and (58) hold also when r = 6, 7, 8 • * * , but the amount of alge- 
braic manipulation increases enormously with each increase in r. We establish 
these results, for all integral values of r, by a more general approacln 

39. A More General Definition. We provide a more general definition of 
K{ai) * ♦ ‘ (ar) by letting the subscripts of the A:’s agree with parts of the given 
partition rather than with its complete order. Thus 

K'(ai)({h) ™ koi+a^iai + (k) + K^^^iaiCk) 

and in general, if ql^ - » . (jr®* represents any p part partition having complete 
order pf ^ ^ then we may define 

’ ■ • (Ur) == ^ ((/P ■ • « (fi*) (69) 

where the summation holds, not only for every different complete order as 
does {49}, but for every possible partition, By (44) (qV <7*0 may be 
written as 

(?** ■ • ■ 9^0 « - 1) I{c24 - 1) ! . . ■ {d, - 1) \T(_d{) . . . id,) 

where di + ^2 4- ^ • + dg — p and where groups of the may be alike. If 
(wJi)(^ 2 ) ■ • • ( 1 ^ 0 ) is one of the products of poVer sums having the complete 
order (di * • • dg) we may write 

(qV ••• (?r) = - 1)1 ^ 1)!WW M {601 

where 

5i Ki 4- • • • + (7 j “ tu ?=: v;i 4 - i £)2 + I * < + 

and 


Xi ^ Xt p 
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tied where the summation agn holds not only for every complete order di > • • d, , 
but for alJ power sum partition products (iej)(m») • • • (««)• 

The insertion of {60) in (69j gives 

• • • (Or) 

= T, S (-l)'"'(di - 1)1 • • • id, ~ DKtei) • • • W lei) 

40. Value of . The notation of JC* is used to indicate the coefBoient of 
the power sum (w) = (oi -t- oj -f • • • + Or) in the expansion of (61 ) . In this 
case di — p and g ^ . 1 so that 

which may be written more symbolically as 

£(-i)''‘(p-l)lft,/ (63) 

where 7r„ represents any algebraic partition of ai + * • • + Or and p indicates 
the number of its parts. 

41. Products of The notation is used to indicate the product 

of iCtf, by Kli if the rule of multiplication is the suEBxing of the subscripts of 
the t's In the expansion of and KLx » Thus 

(feai+Aj *“ i'^aid3)(fcaj) 

More generally, if we write^ from {63| 

< = i:(-i)‘''“U-i)!^ 

and use multiplication by suffixing of subscripts we have 

~ X) ~ l)h‘ • < — 1) (64) 

where p = di da + • • • Hr and the summation hold^ for every partition 
which can be formed by combining any algebraic partition of Wi , any partition 
of , • • • , any partition of % . 

42. The Coefficient of ^ < (wp). The coefficients of any specific 

product of power sums (ta,)(u)0 . . . (u?p) is from (61 ) 

^wnur,...wff — (™1)^ ^(dl^ 1)1 ••• (dp 1)1 [65} 
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where the summation holds, not only for the partitions of ai + 02 + • • • -f Or , 
but for the partitions ‘ partitions can be combined 

to form (wJiK^Ja) Hence (66 j becomes 


KU.,.:.. « D - 1)1 • • • (4 - 166) 

and it is immediately seen that the right hand expressions of (66) and |64) 
are the same and hence that 


K 






as expected from (68), 

We can now say that 

ifXaOW ‘ ‘ * («r) == £ ((?l‘ • • * ^V) 

= S ...Wr • • • (W(?) 

where 

kI ^ 1)1 

and 




v^/ 

Jtxif 


tO|iO]- • ^Wg 


. . . iicl 


{671 

1681 

{691 


Relations {67}, {68l and {69} constitute the general double expansion 
theorem. 


43. The Double Expansion Theorem. The case of the double expansion 
theorem in which we are especially interested is that in which the coefficients 
of all similar power sum products are the same, i.e., is a function of 

the complete order indicated by In this case {681 becomes 

ir„ = E i-ifip ~ 1)1 5. I70l 

where the summation holds for all possible complete orders. Suppose now 
that the r algebraic expressions, Ui , 02 , - • • , Or are all unity then {69} becomes 

■= E (-1)'% - 1)1 ^pTj pT.) fepf'-?:* 

and we find that = Kr . We may then write {67}, |68| and (69) as 


K{ai) . . . 

■ (a,) = E (?>r‘ ■ • • pro « E Kr,...r, nn ) . . . (rj 

1711 

where 



172} 

and 


* * * Kfg 

173} 
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Now m indicates any grouping of tho a\ and hence any complete 
order of ai + aa -f ■ - + . So (71) may be written, with a slight change 

of notation as 

if(fli) • • • (o,) « ' • * p-*) 

The relations (74), (72} and (73) are the desired generalizations of (56), (57) 
and 15S} and hold fox all positive iutogral values of r. 

The double expansion theorem provides a method of writing out the result 
of the double expansion process without going through the work involved in 
the process. Thus 

JC(3)(2)(l) = ^ 3 ( 6 ) X2i|(5)(1) 4" (^)(2) + (^)(^)) 

+ Xin(3)(2)(l) - (h - 3fei + 2fcin)(6) i?^) 

+ (hi ^ ^ni)l(5)(l) + (4)(2) + {3)(3)} + fciii(3)(2)(l) 


44 , The Double Expansion Theorem and Partition Notation, It is im- 
mediately evident that {74} can be obtained from (4) if P{ai • • • a^) is replaced 
by KCaj) ■ • ^ (Or), if Ppp...pTi is replaced by and if - pj* is 

replaced by r(pi)'‘ • • • (p«)'^ It follows at once that the entire theory of 
Chapter I, — ^table, recursion formula, etc.^is applicable to double expansion 
theory. For example (76) above is obtained from 

f(321) = P 36 + PailSl + 42 + 33) + Pni321 

simply by replacing the K*b by the P's and enclosing the parts in parentheses. 
Wo can as well use P's as JC's to represent the double expansion theorem and 
hence have available a list of double expansion formulas when tu g G. We 
also have available a recursion property for writing double expansions beyond 
the scope of the table. Thus for example, the illustration at the end of sec- 
tion 9 may be interpreted as a statement of the double expansion theorem 
when ai = 3, ^ 2, at = 2, ai = L 


46. The Case of Equal Powers. In case ai = 02 = as - * • • 
reduces to (S') of Chapter 1 with 


and 



E(-ir'(p-i)! 







a, {74} 


(76} 


Pfirj ^ P riPra " * ’ Pfj. 

Formula (74) also reduces to {3} when ai = = . * . = 1, 


46, Special Values of Kp*i...p-.. 

A* = 1, In this case the coefficients axe all unity and 

P(ai)(ai) ’ * - (aj) = ^ ^ (a,) 
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It follows that Pr — Q and that = 0 except that Pt = h Placing 

P, = 0 and kp]i.,,pi» - 1 in (72} or its equivalent (76) we have, when r > 1 


0 = i: (-i)^“Xp “ 



(77) 


where the summation holds for every partition of r. This formula should be 
compared with {39j and {40}, When r = 4 and the partitions are 



4 , 

31, 

22, 

211, 

1‘ 


(77) gives 

1 

-4 

-3 

-j-12 

-6 

= 0 

(39} gives 

-6 

+8 

+3 

•-6 

+1 

= 0 

{40} gives 

6 

+8 

+3 

+6 

+1 

- 41 


The equivalent of (77) was first given by Cayley (D; 676) who at the same time 
noted the similarity to (39 j . 

It follows immediately that the sum of the coefficients in the expansion of 
Ppp...pp , except Pir, is 0 , for the sum of the coefficients of Ppp...pp is the sum 
of the coefficients of • • • {PtY* and is 0 , For example the sum of the 

coefficient of P^z = - hn — Sfei + 6^2111 ™ ^hnn is 0 , 

Since the coefficients of (19; 26) in the expansion of Thiele 

half invariants are - 1 ) I [ ^ ) it follows from (77) that the 

\Pi ‘ • P// 

sum of these coefficients is 0 . 

B, . In this case all terms having the same number of parts, 


p, have the same coefficients, 
2, - ► , (67), 176} become 


If wc indicate by pi , pa , . . . , when p = 1, 


Pi = Pi 

P 2 = Pi - P4 

Pfl ^ Pi 3p2 d" ^P3 

P‘1 “ Pi 7p2 “t“ 12p3 6p4 

Pfi ~ pi ■“ 15p2 -\- 50p3 — 60p4 “j" 24p6 , 

etc. 

which are the formulas which have been used by Carver (16) and O'Toole (16). 
Many other additional cases can be obtained by giving different values to 
, but a discussion of these is hardly justified here as the case in which 
is a function of the number of parts, p, is to be used in Part 11. 


47. Relation to Previous Results. No general statement of the double 
expansion theorem has previously been given although the special case ^(aO 
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has been developed by Carver (16) and O’Toole (16). Their results are further 
restricted to the special case (B) of section 46. The application of the double 
expansion theorem in this case is very useful in studying sampling from a 
finite universe as Carver has shown and as is demonstrated in Part II. 

Most writers who have worked on the problem of moments of moments have 
gone through the double expansion process, but Carver was the first to note 
that the result of the process can be written in terms of the P polynomials 
above. It seems appropiate therefore to refer to these P polynomials of the 
coefficients as Carver polynomials. 

Chapter V. The Multipartitlon aad Multivariate Eonaulas 

It is the purpose of this chapter to show how the results of Chapters I, II' 
III, and IV may be extended to the case of different variables. 

48, Multipartitioas. Tables. Formula (4) is still applicable if we let the 
Cl units be the units of one quantity, the Oj units to bo the units of a second 
quantity, etc. Thus for example the formula P(oiasOj) may be used to repre- 
sent the precise number of ways in which oi apples, oa pears and cia peaches can 
be formed into groups without breaking up the groups of apples, pears, and 
peaches, 

Various conventions for representing multipartitions of this type have been 
used. Wc adopt the one in which the individual partitions are written in 
successive columns, The partitions of the first number are combined with the 
partitions of the second number to form all possible multipartitions. Thus the 
multipartite number 111 has the partitions 

111 no 101 on 100 

001 010 100 010 

001 

where the parts arc given in the rows. It is desired to show the number of 
ways in which any one of those partitions may be combined to form partitions 
of fewer parts. Thus ^ 

/ 100 \ no 101 on loo 

FI 010 = p,ni + PjiOOl + PsiOlC -I- PnlOO + PuiOlO 

\ 001 / QQl 

This is obtained from P(a,aja3) by placing ai = li.o^ =* 1 ,, «, = 1 „ and could 
be wntten from (4} as 

^(liljla) = Pidi d- Ij + 1,) d- Pjilli d- Ij'la d-TTTls'd d-ijd- la'll) 
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Similarly 

/ 10 \ 20 02 

P lo\= Pi2 + 2P8i21 + 2 P 31 I 2 + Pw20 + 2 Ph 11 + Pm 01 + PsulO 

loll 2 01 10 02 11 01 10 

\oi/ 

11 10 

+ 4P,ulO + PuiilO 

01 01 

01 

is a special case of P(oi (feCjaO where di = li , os = li, 03 = la, oj = la . For- 
mula {4( is also true where the di units are not of the same kind. Thus 

P((ii(is) =* Ps(di -h da) ■f' Pu(did8) 

gives 


KS) = 


when tti = Ij + la and da == li. 
TABLE III 


The MuUipartile Number 111 


110 

101 

oil 

100 

001 

010 

100 

010 



1 

001 


100 

010 

001 
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TABLE 111— Continued 


The MnUiparUie Number 



22 

21 

01 

12 

10 

20 

02 

11 

11 

20 

01 

01 

02 

10 

10 

11 

10 

01 

10 

10 

01 

01 

22 

Pi 









21 

01 

Pi 

Fn 








12 

10 

Pi 


F« 







20 

02 

Pi 



F,i 






11 

11 

Pi 




Fu 





20 

01 

01 

Pi 

2F« 


F„ 


Pill 




02 

10 

10 

P 3 


2F21 

P2I 



Pui 



11 

10 

01 

Pi 

Fji 

Fa 


Fsi 



Pm 


10 

10 

01 

01 

Pi 

2Fm 

2P31 

P 22 

SPaa 

Pm 

Pm 

4Fau 

Puu 


Tabks can be made for the partitions of the various multipartite numbers. 
In Table III are presented values for the numbers 11, 111, 22. 

When the units are indistinguishable 11 condenses to the ui = 2 part of 
Table I, 

When the units are indistinguishable 111 condenses to the ui s 3 part of 
Table I. 

When the units are alike 22 condenses to the w = 4 part of Table I. 

49. Multivariate Distributions. The chief results of Chapters II, III, IV 
also hold for multivariate distributions, Some additional definitions are neoes- 
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sary. We suppose that the N variates x\ ^ ; , a:;/ are replaced by the 

Nr variates of the array 

j 1^2 j • ' • } 


2Xi f ZX2 j • • • , 

« p • I I I ^ 


{78i 


rXi f rX2 / ' ' ‘ 

where the presubscript represents the variable. The power sums become 
(ai) - la;^ + ixV + • ■ * + 

(da) = d" • T" saij® “ 2 2^?* 

It is not necessary to utilise the presubscript since it is precisely the subscript 
of the a. That is the power sum (ax) is defined by ^ xf. Similarly (aiaj) 
== JL ixT can be written as (uiaO = S xf without introducing ambiguity. 

In general {6) as well as {4), now holds for the multivariate case. It follows 
at once that the results of Chapters II, III, IV can be written for the multi- 
variate case by means of the formulas of Chapter I as indicated by the previous 
section. Thus the formula for f*(lilil 2 l 2 ) may be written as [Table HI] 

p[To*Ib'OT‘Ol] = -h 2P2 i12*Io + P22^^ + 2pTin 

+ P2u^ OT OT + Pan 02 10 lO + 4P2n IT 10 M + PnuTO 10 01 01 
and can be interpreted as: 

(ior(oir = (^)+2 (^.w) + 2(i2.Io) +(m-W + 2(n.Ti) + (^.M-M) 

+ (K-Io-io) + (TT'Io.w) + (Io.Io-oT.m) 

by (12) of Chapter IL It may also be interpreted as 

(lO.TO-OT.M) = - 6(22) + 4(21)(01) + 4(12)(10) + (20)(02) 

+ 2(ll)(n) - (20)(01)(01) - (02)(10)(10) 

- 4(11)(10)(01) + (10)(10)(01)(01) 

by (44) of Chapter IL It can also be interpreted as a doubie expansion by 
means of section 44 where the values of the P's are given by the usual 

A = S (~in - 1)1 ^ _ p,.) fc,p..„r, 


50, Summary. It is apparent that (4) not only expresses (a) the number 
of ways in which the parts of one partition may be collected to form the parts 
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of another partition, (b) the formula for expanding products of power sums 
in terms of power product sums, (c) the formula expanding power product 
sums in terms of power sums, and (d) the formula for double expansions, but 
also that it can be used to make similar expansions in the cose of multivariate 
distributions* 
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ON THE INDEPENDENCE OF CERTAIN ESTIMATES OF VARIANCE* 

Bv Aubn T. Chaig 

1, Introduction. It is well known that a necessary and sufficient condition 
that several statistics be independent in the probability sense, is that the char- 
acteristic function of the joint distribution of these statistics shall equal identi- 
cally the product of the characteristic functions of the distributions of the 
individual statistics. Thus, if *1 , *3 , • • • , are V independently observed 
values of a variable a: which is subject to the distribution function /(«), and if 
, da , ■ > " ) are s statistics, each computed from the N observed values of x, 
the characteristic function of the joint distribution of the 5 statistics is given by 

(fiih, k, "■ ,i,) => J ‘ ■ j ' ■ ■ Hxn) dsy • ■ • dXu 

Here, i = the limits of integration are taken so as to include all 

admissible values of x> Since the characteristic function of the distribution of 
fi* , v = I, 2, ■ ■ • , s, is given by 


ipiiQ 


• • • JixN) dxti ••• dxi , 


the necessary and sufficient condition for the independence of the s statistics 
can be written 

(1) ip{ti , ' " , • ' ■ PjCO, 

for all real values of h , tj . 

An important phase of sampling theory in statistics is that in which the 
variable a; is subject to the normal distribution function 

/{*) = — == ^ ^ 00 < J! < M , 

(T 

and 1 • ■ ■ , are 5 real symmetric quadratic forms in the N independently 
observed values of *, That is, 

N ^ 

N If 

' , 7“1 fc"l 

' A A 

0. = £ E 


j'»i fe“i 




1 Presented to the Inatituto of Mathematical Statiatica on December 30 , 1937 , at the 
invitation of the progam comniitteo, In the paper, we discuBS, from a slightly different 
point of view, some of the material found in the references given at the close of the paper, 

■ 43 
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SO that 



where T = ii X) £ ajitXiXi, + • • • 4- S 22 Pik^i^h - 22 »!■ If 

Ai, "■ 1 A, denote the real synraietric matrices of the s quadratic forms, the 
characteristic function can be written 

r ' ' ' } ts) ^ \ ^ — 2^0“ iiAi — • • ^ — 2i(/taAa I 

where I is the unit matrix of order N and the vertical bars indicate the deter- 
minant of the matrix within them. Similar] the characteristic function of 
the distribution of % is given by 

<Pv(Q = 11- 2ifftvA^ I"*, 

so that a necessary and sufficient condition for the independence of the ^ real 
symmetric quadratic forms can be written 

a 

(3) |/ •- 2i(r^tiAi — ... — 2ifftaAs \ “ 11,^ " 2iffUAv\i 

for all real values of ti , - , fa . 

Although equation (S) is fundamental and la of considerable vabe in certain 
problems, it should be remarked that it is frequently rather tedious to use. 
This suggests that by strengthening the hypotheses, it may be possible to 
establish another necessary and sufficient condition which, in certain cases, 
may be easier to use. 


2. Certain quadratic forms. In order to lead up to such a theorem as that 
suggested at the close of the last section, we first consider two theorems regard- 
ing real symmetric matrices. 

Theorem I. Let Ai, Az, ■ ' - , A, he s real symmetnc matrimy each of order Ny 
such that Ai + As + '*•-(- A, - 7, where I is the unit matrix of order N. Lei 
Tv )V = 1,2, ■ - ySyhe respectively the ranks of the matrices Av . J/ri + rs + • » * 
r, = JV, each of ike non-zero roots of the characterisUc equations^ of the matrices 
Ap zs “I" I* 

If s = 2, the theorem is almost self-evident. For the characteristic equation 
of Az is I Ag — X7 1 = Oj which, since Ai + Az == 7, can be written | 7 — Ai — 


“ By the clmractcristic equation of the square matrix A is meant the algebraic equation 
of degree in X. 1 A — XI | - 0. If A is real and eymmetric and the rank of is r, the 
characteristic equation haa exactly r real non-zero roots and N — r zero roots. CR Kowa- 
Icwski, Eiiiflihriing in die Determinanten-Theorie (1009) pp. 126-128. 
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X/ 1 0 or 1 - (1 “ I - equation is the characteristic 

equation of Ai with X replaced by 1 - X. Thus the roots^ of the equation 
I _ X7 1 “0 are one minus the roots of 1 ^2 ™ XJ | “ 0, Since the equation 
j ^2 - XJ I " 0 has N - n zero roots^ the equation | Ai — X7 j = 0 has N — 
roots equal to +1. But n = so that all the non-zero roots of ] Ai - 

XJ 1 - 0,are +1. A similar statement holds for the roots of 1 Aj — X7 [ — 0, 
In general, we have Ai-l-Aa-f- == 7 and ri-j-r2d- + r‘i, " N, 

Let = Aa + As + • • • + A, and denote by Ri the rank of Bi , Thus* 
< 7*2 + r-g + * ■ ’ + r, , Now Ai + Bi = I and the equation | Ai - X7 1 ^ 0 
has exactly N - n zero roots. Since the roots of ] JSi — X7 [ = 0 are one minus 
the roots of j Ai - X7 | = Oj the first of these two equations has at least N - n 
non-zero roots so that i2i > iV^ — n = rz + rg + ' - ’ + , Prom ra + rg + 

+ r, < < ra + rg -f ' • ■ + r, we deduce the equality so that the argument 

in the case of 8 - 2 applies to the matrices Ai and Bx * In particular, then, 
each of the non-zero roots of | Ai — X7 j == 0 is +L By writing i?2 — Ai + 
q- , . . ^ Bz - Ax + Ai Ai + - * + A, , and so on, and repeating 

the argument in each instance, we see that the theorem holds. 

Theorem IL Lei Ai , A2 , • • • , A« be s real symmetric matrices which satisfy 
the conditions of Theorem I. There ihm eccisi s — 1 real orthogonal matrices of 
order Nj say Li ^ ■ * ■ , , snck that each of the s matrices 

L,„i • ^ • LiAuLi • » ■ Lj™! , a = 1, 2, • ‘ , 8> 

is a diagonal mainx\vnth the r^, nonrzero elements on the priwcipaJ diagonal equal 
to 4- 1. .^ecessant^, the sum of these s matnces is the identity matrix, 

In proof of the theorem we shall, to save space, restrict ourselves to the case 
of 8 = 3, although the method we use will be readily seen to be entirely general. 
Since Ai is real and symmetric and since, by Theorem I, the ri non-zero roots of 
the characteristic equation of Ax are -(-1, there exists a real orthogonal matrix of 
order say Lx , such that 




1 

0 * 

^ 0 

0 .. 

. 0 

0 

• 

1 ^ 

« 

. 0 
*. 


i 

0 

1 

0 . 

* 1 

■ » 

* 

+ 

t 

* 

* 

0. 

* 

■ • 1 > 

« • 1 • 

0 . 

1 

. 0 

+ 

i 

4 • t « 

1 « 1 4 

0 ^ 

.0 



where Li is the conjugate of Lx and where, merely as a convenience of notation, 
we have placed the rj non-vanishing elements of the principal diagonal in the 
first ri rows and columns. If then, in both members of the equation Ai + As + 
As = 7, we multiply on the left by L[ and on the right by Lx , we have 


’Cf. BCcher, Introduction to Higher Algebra (1921) p. 62. 

* By a diagonal matrix we mean a matrix whose elements not on the principal diagonal 
are zero, 
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1 0 * • • 0 i 0 • • • 0 


t • * 5 ♦ 

0 0 ■ ■ ■ 1 0 . . ■ 0 

(4) '■ + L\AiLi + LiAjLi = I, 

0 0 0 

t • * ■ 

i i- I 

0 0 0 

since L[ILi = IL[Li ~ 1. The matrices L[A^Li and Ll^laLi are real, sym- 


metric, and the ranks are and n , since Li is nomsingular. Moreover, the 
non-zero roots of the characteristic equations of the two matrices are +1; for 
I L[AzLi — X/ ! = I 1 - I II ^2 — Xl 11 Li I , and similarly 

for the matrix LiA^Li . Now if a real symmetric matrix is positive definite, 
that is, if all. the non-zero roots of its^ characteristic equation are positive, then® 
ail the elements on the principal diagonal are positive or zero, and, if an element 
on the principal diagonal is zero, all the elements in the row and column in which 
that element lies are zero. These two facts regarding a real symmetric positive 
definite matrix, in conjunction with equation (4), require that the matrices 
LiAiLi and L'lAsLi be of the forms 


0 ... Oj 0 0 ' 

• * 


0 ... O! 0 0 

« • ! * ■ 

1 • • 

0 ... 0: 0 0 





and 


0 ■ . • 0 6 ri 41 ,r,+l ’ • ^ 

« 4 » t 

• • • • 


0 • . * 0 . • • Cri+l,JV 

« • 4 1 

0 ... 0 bjv’.n+i 


* • • • 

0 * . ■ 0 • • • • Ctfft 


respectively* Now the real symmetric matrix 

'&ri+l.r,+l ^ 

: : 


is of order iV — , its rank is Vz , and its characteristic equation has r% roots 

equal to +1. There then exists a real orthogonal matrix M of order iV' — n , say 


such that 






‘ Cf. Cullis, Matrices and Determinoids (1918) jrol. 2, p. 302j^^- 
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to simplify the notatioiij we have placed the n non-vanishing elements of 
the principal diagonal in the first n rows and columns, Consider the orthogonal 
matrix of order N 


1 

0 ^ 

oi 

0 t * • , 

,,,1*0 

0 

1 . 

■ ^ 0 



1 

0 

0 . 

■ ^ 1 

0 ■ ' ' ’ 

, , 1 ♦ • 0 

0 

1 1 • 1 . 

..0 



0 

« ■ 1 1 

1 

.. 0 

* 

i 

• • • • Tfltfff 


It is evident that L^(LUi^i )^2 L[AiLi. If then^ both members of L[AiLi + 
L[AzLi + L'lAiti “ I are multiplied on the left by L[ and on the right by La, 


we get 







0 .. 

OiO 

O 

o 

1 

0 -■* 0 

]0 .. 

. 0' 



1 [ 

4 2 

\ 

« 

U 

* 

1 

1 




0 - 

• O] 

0 ( 

} 

0 

10 

^ 0 




j 



111 

[ 

1 



0 - 

^011 0 

0| 


0 

0 

0 * • 

• 0 


* 

* 

k ! • 

« i * 

" i 
, 1 


1 

t 



i 


■k 

: io •” 

, ij 


0 

* m ^ t ^ m ^ 


• 0 


t 

* 

> 

1 








0 

O'**'' 

1 1 , « « 1 1 * 1 0 



0 

• 

■ 

0 

• * • « « 

, . , 0 





1 

0 

i 

■ 01 

0 

* k w 9 * 

0 




+ 


: 




= L 




0 

■ 

. d 


' dn-t-i.y 

« 





,0 - 

^ 0 


' " djfN 




'From this last equation, it follows that djh - 0, j ^ fc, = 0, j = n + 1, 
’ ■ ' , ri + ra and da - 1, j =3 n + ^*2 + * * • j The third matrix in the 

left member of preceding equation then takes the form 


0 0 ^ 0 {) 
I J 

0 oi 

0 


10 ••• 0 ; 
I • 

I • 

I ■ 

0 ••• 0 


0 


1 0 ... 0 
!■ • • 

f * 

* t 

0 [0 1 


0 


I I 4 » I * t < 
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This establishes Theorem II when s = 3. The procedure may be continued 
in a fairly obvious manner so as to justify the theorem for any finite positive 
integer s, 

With the aid of Theorems I and II, we are now able to state and prove a very 
useful theorem on the independence of certain quadratic forma of normally 
and independently distributed variables. The theorem follows. 

Theorem III. Let Xi, x^, , Xn he W independent values of a normally 

distributed variable x and let di, • ,d, be s real symmetric quadratic form in 

9 y 

tkm N mriahles, where - XI denote respedtively the 

1 1 

Tanks of the quadratic fortns^ a necessary and sufficient condition that the s forms he 
independent in the probability sense is that n + ^'2 + • • • + “ JV. 

Consider the characteristic function of the joint distribution of the 5 forms as 
given by equation (2), In accordance with Theorem II, we can successively 
introduce new variables by performing real linear transformations with orthog- 
onal matrices ii , Ls , * • • , ^*-^1 respectively in such a way that" T becomes 


ri rj+ra ff 1 ^ 

1 n+l ri+* ’ •+r4— 1+1 1 


Since each transformation is orthogonal, the absolute value of the Jacobian in 
each instance is unity. Thus the right member of (2) can now be written as the 
product of s sets of integrals, the sets containing ri , r 2 , • ► * , integrals re- 
spectively, That is, 


^(^1 3 * ' ■ , y * • • ^9{ta)t 

which is equation (1). Hence the theorem. 

Under the conditions of Theorem III, the characteristic function of the 
distribution of is found by direct integration to be 

^ (1 - 2ic Q ^ 


^ If the variables in a symmetric quadratic form with matrix A are transformed by a 
linear transformation with matrix B, the new form has the matrix B' A5. Cf, B6eher, 
p. 129. It should be remarked that these 5 — 1 successive orthogonal transformations can 
be combined into a single orthogonal transformation with matrix L « LiLt ■ • • . For 

if, by means of a linear transformation with matrix Li , we pass from the variables ai , • • ■ , 
Xif io the variables ic/ , • • * , , in which the old variables are expressed explicitly in terms 

of the new, and thence to variables x[, •• • , % by means of a linear transformation with 
matrix Ba , the transformation with matrix Z/iLa will carry ue directly from the aj'a to the 
a;"'8. This extends to any hnite number of transformations. Since theproduct of any two 
orthogonal matrices is an orthogonal matrix (and hence the product of a finite number of 
them), we see that the remark is justified, Of, Bucher, p, 68 and Kowalewaki, p. 161, Note 
that Bdoher expresses the new variables explicitly in terms of the old. 
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Thus, 

/v(^v) ~ ^ j ^ ’ptiiu) 

so that the variables 6 ,/ a are distributed in accordance with Chi-square dis- 
tributions with r, degrees of freedom/ Accordingly, when the conditions of 
Theorem III are satisfied, we may deduce not merely the mutual independence 
of the 6, but also the nature of their distributions. 

3. Applications to the analysis of variance, In the analysis of variance, 
N = ah independently observed values of a normally distributed variable are 
classified into a rows and b columns in accordance with some relevant scheme: 

^11 } > * * ' J 

3 C{jl ) X22 i ‘ > SJ'SSb 

« • ■ 

« % « 

I • • 

# 

With the notation x^. to denote respectively the arithmetic mean of the 
jth row^ the kih column, and the entire set , it is readily seen that 

S {^ik — xf ~ b jS)* + a 2 + S 2 

(5) 1 1 1 1 11 

(^ 7 )f ■“ X;, X.fc X) 
= + ^3 + O3 

is an identity in the N - ah values of x. It is quite straightforward to exhibit 
each of the three terms in the right member of (6) as a real symmetric quadratic 
form in the N variables Xjh and to show that the ranks are rj — a — 1 , — i? 1 , 

ra « (a - 1)(6 - 1). By the device of adding Si 4 (2 2 ^ikY - to 

both members of (6), we have 2 2 + ^4 . Moreover, the rank 

of 04 is u — 1 , Thus ri + rg 4* rj d- n - ab = N and, by Theorem III, we see 
that the four quadratic forms arc mutually independent. In. particular, $i , 6 ^ 
and 63 are independent, and each, measured in units of is distributed as is 
Chi'square with its appropriate number of degrees of freedom. 

Thu Ukivehsity of Iq^a.. 


By the number of degrees of freedom of a real symrtietrio quadratic form of normally 
and independently diatributed VariableB, we mean the rank of the matrix of the form. 





INDEPENDENCE OF CERTAIN ESTIMATES OF VARIANCE 65 

EEPERENCES 

(1) M. S. Bartlett anp J. Wiskart, The distribution oi second order moment statistics 

in a normal system. Proceedings of the Cambridge Philosophical Society* 
vol, 28 (1981-32) pp. 466-469, 

The generalized product moment distribution in a normal system. Same journal* 
vol. 29 (1932-33) pp* 260-270* 

(2) W, G, Cochran, The distribution of quadratic forms in a normal system. Proceedings 

of the Cambridge Philosophical Society, vol. 30 (1933-34) pp. 178-191. 

(3) R. A PisHBR* Applications of Student’s distribution. Metron, vol* 6 (1926) pp. 

90-104. 

Statistical Methods for Research Workers (1934) pp, 210-272, 

(4) S, S. Wilks, Statistical Inference (1936-37) pp. 38, 44-46. 



VARIANCE OF A GENERAL MATCHING PROBLEM* 

By Joseph A. Gheenwooe 

Let us match two decks of cards: (A) composed of t distinct groups of s 
identical symbols each, and (B) a target deck composed of ii symbols of the 
first kind, it of the second, etc,, such that 

tj "1“ ' ' * "b it ^ ef Tit (1) 

It is not necessary that all the i's be different from zero, 

(a) Forming the Felatim Frequency Table, The first part of the paper is 
concerned with forming a 2x2-way table .showing the relative frequencies of 

4 

hits and misses of all pairs of cards in the target deck. The notation ^ indicates 

% i 

a miss at the ith card of the target deck, ^ a hit. ~ j indicates a miss at the 

ith card, with the matching card identical to the jth target card. 

Case I. Uh and jlh target cards the same symbol 


i 3 

If 0 then — 0 
0 1 

1 0 

1 1 

* 


Theoretical freq, 
n - 1 
S 

n - 5 
5-1 


Weighted freq, 

{i ^ i)(n -5-^1) 2.1 

(t - 1) 8 = n "» 8 
n — B 

5 ™ 1 


2.2 

2.3 

2.4 


( 2 ) 


Total = t{n ~ 1) 


But occurs in (( - l)/{ of the events. Thus we must weight 2,1 and 2.2 

with a factor {I - 1), giving the last column in (2). 

Case II. ith and jlh target cards different 


1 

i Theoretical freq. 

Weighted freq. 


0 = j then — 

0 - 8 

n — s 

3.1 

o = i 

1 8-1 

8—1 

3,2 

j 

0 n - 8 - 1 

(n - s - 1)(^ - 2) 

3.3 

Q j 

1 8 

s{i - 2) 

3.4 

1 

0 It - 8 - 1 

n - s - 1 

3.5 

1 

1 S 

s 

3.6 


( 3 ) 


Total = t{n - 1) 


‘Preaented to the American Mathematical Society, September 9, 1937. 
' Read, ‘then out of n - 1 times’. 
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But Q = i occurs in l/{< - 1) of all events q, and ^ occurs in 1/i of all events 

t I 

^ ^ . Therefore entries 3.B and 3.4 must be weighted with the factor — 2), 

and then entries 3.1, 3.2, 3.3 and 3.4 must be weighted with the factor (i 1). 
It is important that the totals of the two parts to be weighted be equal before 
the weighting factors are applied, This gives rise to the last column in table (3) . 

Now the number of ways the tth card can be like the jth card of the target 
deck is“ 



The number of ways they can be unequal is 


1.’ 

E /- 

»<V 


Oii 


( 4 ) 


Since the totals of the last columns of the two tables are equal we weight the 
entries of their last columns with ai and aa , respectively. So, combining 3.1, 
3.3 and 3.2, 3.4 we form on times (2) + a% times (3) to give the new table 


i 

0 

0 

1 

1 


j 

0 

1 

0 

1 


Relative frequencies 

(?X — 5 “ 1}(^ — 1)0:1 + [{t — — 5 — 1) + 1]«2 

{n - 5)ai + 

(ii. “ 5)0^1 “I” 

(s — 1 )q!i 


(n ^ S 1 )q!2 
(n s - l)as 


( 5 ) 


80:2.. 


Now using the entries from (5) form the 2x2-way table 


Total 


(t - l)(w - 8 - l)o;i + 
[(i - l)(n - s _ 1) 

T* 1] ofj 

(?t — ®)oil “I" 

(n~ s - l)at 

(ln~n-t + l) 

(n ~ s)«i -f 
(n - s ~ l)a, 

(s “ 1)0:1 802 

(n ^ l)(ai “h oiz) 

(tn - n “ ^ + 1) 

(ofi -b Qia) 

(n - l)(o:i + (Xi) 

i{^ ^ ^)(^i 4“ 02 ) 


* If ip < 2 define 


&)- 


0 . 
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(b) Obtaining the Correlation, Variance and Maximal Conditions. Sub- 
stituting from table (6) into the formulas given by Yule’ for 6 and the coefficient 
of correlation r, we obtain the average correlation 


r = 


ai 


+ (1 - t) 


01 


© 


(oii 


an- ft + 


fcti 4" (1 




(7) 


© 


(in — n — f + 1) 


by (4). 

We now give a proof that r is a jnaximum when ^ (i = • * * ; 0* 

(7) it is sufficient to show that under the same conditions is a maximum. 
Let if - s 4* then 


ii = 0 by (1). 


( 8 ) 




= s' " (ft) "b S ^li^tp by (8). 

1i<V \*/ H<V 


Assume some 6^ y 0 and 


Add 


S ^ 0. 

w<v 


It— .t Ip— ,( 

u<v 


(9) 


to both sides of (9). Then 

( 2 + S 5w5t, (10) 

or 0 ^ a positive number. This necessarily implies the desired result. 

*Yulej G. U. An Introduction to Ihe Theory of SiatUHcs, London; Griffin and Co., 
1927, ppp 216-217^ Tho table can be symbolized with 

Total 


Total 


the eorrelation coefficient, 


ai 



i. 

6. 

w 

Cl . 

Cs 

Cs 


5 S3 6j — (ci6j/cj) 

He then gives r ^ Scj/A/cciagTi, ’ 
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Yule* gives an expression for the variance in a situation which includes the 
present problem as a special casej to be 

= 7ipg[i + r(n ~ 1)], 

where r is the average correlation between all pairs of variables, Substituting 
our result (7) in (11) with p = l/< gives the desired variance, 

It is interesting to note that when z; = s, (; = 0 ’reduces to l/(n - 1)* 

giving 

j _ n\l — l) _ n 5 
Hn ~ 1) “ n - 

where erj is the variance of the binomial case.® 

Duke Univbrsitv, 


* Op. oit.f p. 286. 

'Concerning this apeoial case sec also Bartlett, M. S. Pmerlm of mfHamiv and 
atati&lical Ms. Proc. Royal Soc. A. 1937, CLX, 268“282. 

Olds, E. G, A rnoment-gmrating function meful in certain matching problms. Abstract 
No. 428, Bull. Amer. Math, Soo. 1937, XLIII, 779. 



THE URGE-SAMPLE DISTRIBUTION OF THE LIKELIHOOD RATIO 
FOR TESTING COMPOSITE HYPOTHESES' 

By S, S. Wilks 


By applying the principle of maximum likelihood, J. Neyman and E. S. 
Pearson' have suggested a method for obtaining functions of observations for 
testing what are called composite statistical hypotheses, or simply composite 
hypotheses. The procedure is essentially as follows; A population K is assumed 
in which a variate x (x may be a vector with each component representing a 
variate) has a distribution function f(x, Si, St, - Ok), which depends on the 
parameters Si, 82 •>< $k. A simple hypothesis is one in which the O'a have 
specified values. A set Q of admissible hypotheses is considered which consists 
of a set of simple hypotheses. Geometrically, fl may be represented as a 
region in the Mimensional space of the 8 's,. A set w of simple hypotheses is 
specified by taking all simple hypotheses of the set fl for which Oi « On , i = 
tn "h 1, w 4" ‘ 

A random sample 0„ of n individuals is considered from K, 0„ may be 
geometrically represented as a point in an n-dimensional space of the a's. The 
probability density function associated with On is 


(!) “ n fixtt ,81, Si, • • • 6a) 

Let Pa(0«) be the least upper bound of P for the simple hypotheses in £2, and 
P«(0n) the least upper bound of P for those in w. Then 



P«(0n) 

Pd(0„) 


is defined as the likelihood ratio for testing the composite hypothesis H that 
On is from a population with a distribution characterized by values of the 8 { 
for some simple h3rpothe8i8 in the set w. When we say that H is true, we shall 
mean that On is from some population of the set just described. In most of the 
cases of any practical importance, P and its first and second derivatives with 
respect to the 81 are continuous functions of the Si almost everywhere in a certain 
region of the 6-space for almost all possible samples On . We shall only consider 
the case in which Pn(0„) and Pu{On) can be determined from the first and 
second order derivatives with respect to the 6’s. 


’ Presented to the American Mathmatical Society, March 20, 1937, 
“Phil. Trans. Roy. Soc. London, Ser. A, Vol. 2S1, p, 296. 
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A considerable number of currently used statistical functions for making tests 
of significance can be expressed in terms of X ratios, and in many cases involving 
normal distribution theory, the exact sampling distribution of X is known. 
However, it is often useful when dealing with large samples to have an approxi- 
mation to the distribution of X. We shall consider sucii an approximation for 
those coses (which include most of the ones of any practical importance) in 
which optimum estimates of the (?^s exist. That is, we shall assume the existence 
of functions h(xi , - • • (maximum likelihood estimates of the Oi) such tliat’ 
their distribution is 


(3) 


\Cii 


. |i n 




(l -f" (f) dzi » ' • dz)^ 


where ^ denoting mathematical expecta- 

__ \ d(fj / 

tion, and is of order 1/Vn ||c, 7 || is positive definite. Denoting (3) by 
Jdzidz 2 - ‘ j and differentiating J with respect to Ok , we get 

Since Cf/ ” 0(1) and |ci-^ | 0, it can be seen from (4) that the values of Ok 

which maximize / differ from Ok^ k = 1, 2, *.' ■ A, by terms of order l/^n* 

Therefore, the maximum Pn(Op) of J with respect to the Ok is 

where = 0(l/\/n). 

To get Pw(0„), we let ^ Coi 1 = w + 1; + 2, • * • h, and note that J can 

be written as 


( 5 ) 

where 


Jo- 


Coj/ 


I 

“i S 
, L /-1 




(27r}^/^’ 


(1 + ^o) 


(6) Xo “ £ c'liZiZf, ifi'o = 0(1/ Vn) 

and II (1 18 the inverse of the matrix obtained by deleting the first m rows and 
first m columns from H Ci/ |p^ and Z{ Z{ Li , Li being a linear function of 
■ • * % # and Co(f is the value of c,/ with 0^ Oa s i - m + m 2^ " ■ 5, 
that is, when H is true. Taking the maximum ?w(0„) of expression (5) with 
respect to , ^ 2 , • • • , we get 


( 7 ) 


= lip + ■^» ) ^»=0(l/v^) 


*For conditions under which the J’a exist which are distributed acoordlng to (3), see 
J, L. Doob, Probability and Sfcatisticjj, Trans, Amer, Math, Soo. Voh 36, p. 769-77B. 
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Hence, when H is true, we have, from (6) and (7) 

(8) X « + 0(1/ Vti))' 

■1 Q \yn} 

Therefore, except for terras’ of order 1/V«i 

(9) -2logX = xl. 

Now, the characteristic function of -2 log X is 


^(0 = = 




dzi dzs 




-1 s '(t'ji5+x5n'i-l) 


(1 + 0(1/ V^)) dsi 



It can be shown that on any finite interval | i [ < a, f{t) approaclies uniformly, 
as n ^ OQ , the function 

A— 

(11) 

But (11) is the characteristic function of any quantity distributed like with 
A - m degrees of freedom. 

We can summarize in the 

Theorem: If a population mih a variate x is distributed accordiTig to the pvohaUJr 
ity function f{x^ , ^2 • • » 0h)\ ^ch that optimum estimates h of the 6i exist which 
are distributed in large sampfes according to (3), then whn the /ij/pot/iesis H is 
true that -f- Ij ^ + 2, - . A, the distribution of - 2 log X, where \ 

is givenhy (2) is, except for terms of order l/Vn, distributed like % Wi/i h 
degrees of freedom. 


Princeton Univbrbitt, 
Princeton, N. J. 



OK DIFFERENTIAL OPERATORS DEVELOPED BY O’TOOLE 

By M. Zim-Dm 


1. O’Toole in his paper 'Symmetric Functions and Symmetric Functions of 
Symmetric Functions’ [Ann. Statist. 2. (1931)102-49], has expressed Monomial 
Symmetric Functions , in terms of power-sums, Sr ■ 

The Monomial Symmetric Functions can be written in partition notation as 
(j ir ip’* " ’ ) where ii , , ■ > - denote the repetitions of parts. 

To express - ■ •) as a function of s ', , O’Toole has developed operators 
dr and £>, , connected by the formulae, 


(A) 

(B) 


d, ~ *7^ , 


d 

ds. 


rdf = 


rli)r = 


Aiilfcjl ' ' ; 

SrldX’ 

klkl--- ’ 

where kjA -f- kS + * ■ ' = r 


ki "I" ^2 - 1 . “ 

In this paper it will be shown that these operational relations are easily 
deduced from the operators d, and D, of Hammond, used for expressing Mono- 
mial Symmetrio Functions as functions of Elementary Symmetric Functions, Or . 

For the sake of distinction I shall use {, and Q, for the operators employed by 
O’Toole and keep dr and D, for Hammond’s Operators. 

Maomahon has dealt with Hammond’s operators in his Combinatory Analysis 
Vol, I Cambridge University Press (1916), where they are defined’ as 




j d I d , d ( 

Uf — “T T I ^2 1 

tor wCtf+i U(tr+2 



2p It is known^ that 

log (l — diSJ -f" 4" * * ^ 4* 4* ’ * ' 4* ^ 4" * ' 


^ O’Toole, loc, cH,, pf IM. 

* Mflcmahoii, Comb* Analysis* I. 27-28, 
*Ibid*,p. 6* 
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Now operate on the right hand side with dr , and with its equivalent in (1) on 
the left hand side, Equating coefficients of / on both sides, we obtain, 

drSr ^ drSk = 0 when r 9 ^ k, 

which yields 

d, s= (-irv^ = {-irVffr. (2). 

The operator Qr exactly behaves like Dr . From the formula 

dr — Dldr^l + Ac^f-2 — Didr^Z + * • * + = 0} 

which is ivL complete correspoi^deiice with Newton's xecurrenee relation, we 
derive 

di *= Di 

rfa Df - 2 Di (C) 

d, = Dl ■» WiD, + 31 ) 3 . 


By multinomial theorem 

fcdij! • . • 


using (2) we at once get 

rq,= (-\) 


which is the result (A) obtained by O'Toole. 

From (C), Dr follows in terms of d!r and thence with (2) can be expressed in 
terms of Qr . Using multinomial theorem, we arrive at 


which is (B), 


r!0r 


Erldl'4’ 

h\h\ 


Btence both the results of O’Toole have been deduced. 


3. In his second paper' O’Toole defines symmetric functions for more than 
one system of Variates. I call such symmetric functions Hyper Symmetric 
Functions, 

The Hyper operators are developed to express Hyper symmetric functions in 
terms of hyper power-sums. They are defined by O'Toole by the following 
relations; taking into consideration two systems of variates only, 


^ p. 29* 

» Ann. Stat. 3. (1932), 66-63* 
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(A)' 

dpQ 

(B') 

Dpq == 




y A’‘i 


f 


falfel ’ ' ' 

where kpi + fepj + • • • 

"I" — j 

These jelations reiftdiJy foJJow from MACD]sban’s‘ hyper operators and 
Oj,,, These operators came into existence with the problem of expressing 
hyper symmetric functions in terms of hyper elementary symmetric functions 
and they are connected by the following relations. 

^ ^ "fcjy. : - • • • 


Pi!?i! P2!?2l "■■ 


11. 

Macmahon’ has' also shown that 

from which wc get 

fa ("I)"’'*''' 


pi?! 


(p + g-l)!' 


p!?! 


(p + 9 - 1)1 


d 


PQ 


(3) 


The operator G behaves like D of O'Toole. Now using (3} we derive from (I) 
the result (A') arrived at by O’Toole without reference to Macmahon, Simi- 
larly from II. using (3) {B') is deduced, 


Uniyshsity Collbob, Swansea. Wales. 


* Macmahon. Comb. AnalysU. Vol. II. Cambridge University Press (1016), p. 302. 
^ Macmahon Op. Git., p. 304. 



GRADUATION BY A TRUNCATED NORMAL 
By Nathan Keypitz 

Below is a table for finding the constants of a truncated normal by the equa- 
tion of moments. Karl Pearson* gives such a table for the case in which the 
data are to be fitted to the "tail” (i.e. less than half) of a normal curve but I do 
not believe that the formulae for a distritation consisting of more than half of a 
normal curve have before been tabulated. 

The table below was calculated primarily for an investigation being carried 
out on the duration of unemployment. The Canadian Census of 1931 reported 
the number of persons losing 1-4, 6-8, • • • 49-52 weeks in the course of the year 
June let, 1930 to June 1st, 1931, by various classifications, (industry, province, 
age, etc.), 

The tendency to report even numbers of months on the part of the enumerated 
population was evident in the result, and some kind of graduation was necessary 
for an interpretation. After some experiment a part of a normal curve was 
settled upon as the simplest and generally most satisfactory representation. 

It was found that among the classes of workers in which unemployment is 
high the curve is more advanced,— i.e, the mode is at a higher number of weeks,— 
than in the classes where unemployment is low. In many cases, (in most 
groupings of female workers for instance) where unemployment is relatively very 
low the modal pomt of the uucurtailed normal stands at a negative number of 
weeks,— for these cases the fitting is to a true tail and the tables of the Biometric 
Laboratory were used. 

Details of the results of the investigation will be published shortly in the 
Unemployment Monograph of the Dominion Bureau of Statistics. Meanwhile, 
this table will be of use as the complement of Pearson’s tabulation which is only 
suitable for ^ .5708, 

Tabk for finding the amsidnts of a truncated normal by the equation of moments 






<I 

0 

,6708 

-.0180 

1.2533 

~ .0562 

.1 

.6528 

-.0183 

1.1971 

-.0643 

.2 

,6345 

- .0188 

1.1428 

-.0626 

.3 

.5167 

-.0190 

1.0902 

-.0,606 

.4 

,4967 

- ,0193 

1.0396 

~ , 0487 

.5 

.4774 

-.0195 

.9909 

-.0467 


‘Tables for Statisticians and Biometrioians, page 25 . 
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X 

h 


h 


.6 

.4579 

-.0195 

.9442 

-.0449 

.7 

.4384 

- .0196 

.8993 

-.0428 

.8 

.4188 

- .0196 

.8566 

-.0409 

.9 

.3992 

- .0194 

.8156 

-.0390 

I.O 

.3798 

- .0193 

.7766 

-.0370 

1.1 

.3606 

- ,0189 

.7396 

-.0351 

1.2 

,3417 

-.0185 

.7045 

- ,0332 

1,3 

.3232 

-.0180 

.6713 

-.0315 

1,4 

.3052 

- .0175 

.6398 

-.0296 

1,6 

.2877 

-.0170 

.6102 

-.0279 

1.6 

.2707 

- .0163 

.5823 

-.0263 

1,7 

.2644 

-.0166 

.5560 

-.0246 

1.8 

.2388 

- .0148 

.5314 

-.0232 

1,9 

.2240 

-.0141 

.5082 

-, 021 « 

2,0 

.2099 

-.0134 

,4866 

-.0204 

2,1 

.1966 

- .0126 

,4662 

-.0190 

2.2 

.1839 

-.0118 

.4472 

-.0178 

2,3 

.1721 

-.0110 

.4294 

-.0166 

2.4 

.1611 

-.0103 

,4128 

-.0156 

2.5 

.1508 

- .0096 

,3972 

-.0146 

3.6 

.1412 

-.0089 , 

.3826 

-.0137 

2.7 

.1323 

-.0083 

.3689 

-.0128 

2.8 

.1240 

-.0076 

.3561 

- .0120 

2.9 

.1164 

-.0071 

.3441 

-.0113 

3.0 

.1093 


.3328 


3,5 

.0813 


,2856 


4.0 

.06246 


.24999 


4,5 

.049379 


, 222221 


5.0 

.0399997 


, 1999999 



Let d = distance of centroid of actual distribution from point of truncation, 

Lot S - standard deviation of distribution about its mean. Then vt'i =5 * 

ct 

Heiu'o ootTesponding ^-ntl ^2 may be found, 

Theji - d4'2 j wJicro <r = standard deviation of uneurtailed normab 
And X = x'ffj whore x = origin of iincurtailed normal. 

N.B, The point of truncation is taken for the origin in the original distribution. 

SociAb Analysis Branch, Dominion Bureau of &rATiSTics, 

Ottawa^ Canada 



REPOIIT OF THE AMUAL MEETING OF THE INSTITUTE OF 
MATHEMATICAL STATISTICS 

The annual meeting of the Institute of Mathematical Statistics was held on 
Wednesday and Thursday, December 29-30, 1937, in Indianapolis, Indiana, in 
conjunction with the meetings of the American Mathematical Society and 
associated organizations. 

The Wednesday morning session was devoted to applications of statistics to 
industry and engineering. On Thursday morning, the Institute held a joint 
session with the Mathematical Society for the presentation of voluntary papers 
on probability and statistics. This session was immediately followed by 
another of the Institute for two invited addresses. These addresses were 
“The theory of general means" by Professor E. L. Dodd, and “On the inde- 
pendence of certain estimates of variance” by Professor A. T. Craig. Professor 
P. R. Rider was in charge of arranging the program. 

On Thursday noon, there was a luncheon at the Marott Hotel for members of 
the Institute and their guests. After the luncheon, Professor H. L. Rietz spoke 
on “The future of the Institute in relation to mathematical statistics.” 

At the business meeting, which followed the Wednesday morning session, 
President Shewhart announced that these officers had been elected for 1938 : 
President, B. H. Camp, Wesleyan University; Vice-Presidents, P, E. Rider, 
Washington University, and S. S. Wilks, Princeton University; Secretary- 
Treasurer, A. T. Craig, University of Iowa. The Institute voted to hold its 
1938 meeting with the American Statistical Association. The meeting will be 
in Detroit, Michigan, in December of this year. 

Allen T, Chaig, Secretary. 
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TESTS OF STATISTICAL HYPOTHESES WHICH ARE UNBIASED IN 

THE LIMIT 


By J, Neymak 

L Introduction* The idea of unbiased tests of statistical hypotheses has 
been put forward and discussed in two recent papers,^ Recently also a particular 
problem was solved introducing a test which has the property of being unbiased 
in the limit.^ The purpose of the present note is to discuss this conception in 
its general form and to indicate methods of determining the tests unbiased in 
the limit of a broad class of simple statistical hypotheses, The notation and 
the terminology employed below are explained in the papers quoted. 

2. Notation and definitions. Consider a set of n random variables 

( 1 ) 

the particular values of which 

(2) itj. j ^2 J ' ‘ ' Xt\ 

can be given by observation and denote by the set of hypotheses concerning 
the probability law of (1) which are regarded as admissible, We shall assume 
that all the hypotheses included in specify the probability law of the 
having the same analytical form but differing among them in the value of just 
one parameterj 0, Thus, if En denotes the point (the “event point^O in the 
space Wn of ^ dimensions with its coordinates equal to the values of (1) and Wn 
SL7iy I'egion in Wn , then the probability of Bn falling within Wn , as determined 
by any of the hypotheses forming the set U will be denoted by 

(3) 

and will be a function of the parameter The probability (3) with fixed 9 
considered as a function of varying Wn is called the integral probability law of the 
J’s. Frequently (3) is equal to the integral of a certain non-negative function of 
En over the region Wn • This function will always be denoted by 'piEn \ 9) and 
called the elementary probability law of (1), 


^ J. Neyman and E, S, Pearson: ContributioTiB to the Theory of Testing Statigtioal 
Hypothoacs. Part L Sfcat. Res. Memoira, Vol, 1, (1936) pp, H7. Part II, ibid,, Vol. II 
(1938). 

J, Neyman ; Sur la verification des hypotheses atatietibues compoa6es. Bull. Soc, Math, 
do France, Vol 63 (1936), pp. 246-260. 

^ J. Neyman; ^‘Smooth^’ Test for Goodness of Fit. Skandinavisk AktUarietidskriffc, 
(1937); pp. 149-199. 


69 



70 


J. NEYMAN 


Denote by Ho some particular hypotliesis of the set and by Oo the value 
that it ascribes to the parameter 0 . 

A test of the statistical hypothesis Ho consists in a rule of rejecting Ho when- 
ever E„ falls within a specified region lOn and in not doing so in other cases. 
The region used for this purpose is called the critical region. It follow.s 
that to choose a test means to choose a critical region. 

We shall consider below only cases such that for any region to,, the probability 

(3) considered as a fvmction of fl possesses two successive derivatives. 

DsivA’moA’ 1. Jf a mlical region S>n has Ihc frop&Hy Ihcd, a boitig a fmd 

positive number. 

(4) (a) tOnl^oi = a 


(5) 

(fi) 


(b) 

(c) 


d 

dS 


dS^ 


P(H„ ^ I fll 


= 0 




where Wn is any region satisfying (a) and (b), then the region Wn is called the un- 
biased critical region of type A corresponding to the level of significance «, and the 
test of the hypothesis Hobased on iOn , the unbiased test of type A, 

This is the definition given in the first of the earlier papers quoted. Now we 
shall define the test which is unbiased in the limit. For this purpose we shall 
have to consider the situation where n is indefinitely increased and consequently 
we have a sequence of probability laws (3), a sequence of spaces Wn where they 
are defined and a sequence of regions Wj ^ , each being a part of the cor- 
responding Fn ‘ 

We must also introduce a varying scale with which to measure the differences 
0 - ^0 - This is due to the fact that, if the choice of the sequence of regions 
Wn is not very unlucky and d 9 ^ Oa ^ then we shall frequently have 

(7) lim P{En € == 1 

Comparing this with condition (4), we see that in general the limit of 

P{EntWn\e\ 

for 71 -i- 00 will be discontinuous at , To avoid this we shall measure 
6 — (/(j in terms of n ^ introducing instfcad of 0 a new parameter connected 

with the former by means of the equality 

( 8 ) ^ 9 = 

For the hypothesis tested Ho we shall have = 0 and ^ 0 for any other 

hypothesis in ft. The new parameter thus introduced will be called the 
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standardized error in Hq , It will be frequently convenient to use 6 but occa- 
sionally we shall use as well, for example writing I instead of 

(3) etc,, and it is necessary to remember the connection (8) existing between 6 
and i?. It may be useful to notice at once that df/dB == •\/n df/d^. 

Definition 2, Wb shall say ihai the sequence of regions 

(9) HJ] , w>a j * • • > ' 


determines a test of the hypothesis Ho which is unbiased in the limit and coji'csponds 
{in the limit) to the level of significance if for any n 


(10) 


(d) 






where Wn is any region such that 


(U) 

and 

( 12 ) 

and if 

(13) ' 

(14) 


P{EnfWn I I? = 0) = P\En « i5„ | •? = 0) 


d 


P{E^€Wn\^\ 


= fp{E„(WM\ 

uu 




(e) lim P\En e 1 1 ? = 6 } = a 

(f) lim 6 I dU J = 0 

CLu 


The practical application of the test determined by the sequence of regions (7) 
consists in observing as large a number n of the X*s of (1) and in rejecting the 
hypothesis Hq whenever En falls within tDn * If n is sufficiently large, then this 
rule will have about the same advantages as the application of the unbiased test 
of type A, In fact; allowing for the circumstance that the values of (11) and 
(12) will be only approximately equal to the limits (13) and (14), the properties 
of the test satisfying the Definition 2 will be as follows: If the hypothesis tested 
be true, it will be wrongly rejected with a relative frequency approximately 
equal to a fixed in advance. If Ho is false and the true value say & of t? is not 
very different from zero, then the frequency of rejecting Hq will be greater than 
a and could not be increased by applying some other similar test. 

It may be useful to notice that in general there may be more than one test 
of the same hypothesis which is unbiased in the limit and corresponds to a 
fixed level of significance. Consequently there is a possibility of choosing 
between such tests, but it seems to the author that such a choice would require a 
previous strengthening of the theorem of S, Bernstein on which the present 
work is based. 
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3. Theorem of S» Bernstein, In the following, we shall have to use the 
following particular case of a theorem clue to S. Bernsteiu,^ Denote by S(a;) 
the matliematical expectation of any variate x and by 


(15) 


Xj j X2 j * ■ ‘ j X ,i , ' • • 

two unlimited sequences of random variables. 

We shall assume that 

(1) Xi is inclependeiit of X,- and Y / for any i 7 ^ j. 

(2) The following mathematical expectations exist and are independent of i: 

§(Xi) = a - h 

&{Xi — of — <ri &(Yi — 

6[(Xf - a)(Yi ^ 5)1 - mo-2 

«(( Xf - a T) = /i g{| 7.- ^bf) -i' 

Consider now the space of 2n dimensions Wn and denote by En a point in it 
as determined by the values of Xi , Fj for i ™ 1, 2, * * • considered fl.s its co- 
ordinates. Let Un and denote the sums 


(16) 


(17) 


11 


“ E y< 


and denote by D„ the point on a plane S witii its ortiiogonal coordinates equal 
to Un and Vn* If 5 is any region in S then let P[Dn e be the probability of 
falling within s. 

Thi50TIEM ot S. Beih^stein, If the variates (15) satisfy ike co 7 iditions (i) 
and (2) rten, for any e > 0, there exists a nutnber Ni , such that the mequah'ti/' 
n> Nf implies 


(18) 


me - 


2arnaiiri '\/ 1 — r ^ 


_ t / (u— na)^ u'-nfl p-nfe (!■— 

ran<i-r 2 )\, ^ Jt n dudv 


< €| 


whatever the region s in S may be. 


4. Tests unbiased in the limit. We shall consider the problem of determining 
the tests satisfying Definition 2, in the case where the following hypotheses are 
fulfilled. 


® S. Bornatein; Sur un th 6 or 6 nie limits du ealqiil dea prohtvbilit^s. Math. Ann., Bd, 07 
(1025) p, 44. . ■ 

See also V. Romanovskij, Bull, dc l’Acad 6 mi 0 dea Sciences dc I'U. R. B. S., 1029, p, 209 
Btid W. KoaakLewicK, Arm. Soo. Polonaise Math., t. XIH (1934), pp. 24-43. 
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(i) All the random variables (1) are mutually independent and each of them 
follows the same elementary probability law which we shall denote by p{xi \ 0). 

(ii) The elementaiy probability law | ^) admits three differentiations 
and two consecutive differentiations, with respect to 0 under the integral taken 
over any fixed finite or infinite interval, so that 


for fc = 1, 2. 
(in) If 


( 20 ) 


<Pi = 


alogp(a:i|^) 


de 


\6 ^$q 


and 'i'i = 


logp(a;^|^) 

d9^ 


\e^6o 


then we shall assume the existence of the following integrals all taken from 

^ C 30 to + «> 


( 21 ) 

( 22 ) 

(23) 

(24) 
(26) 


= j iph(xi I 6<i)dxi 


o\ ~ I (’®'i + <ri)” p(Xi I 6o)dx, 


Cffifl-j “ / 'pi'^iP(xc I 6i)dx 


M = 


Vi I p(xi I ffo) dxi 


V - + o-i I* p{.Xi I d^dxi 


Proposition I. If the above ctmdtiions (i), (ii) and (iii) are satisfied, 
being a function of Xi and | r | < 1, (ken (he sequence of regions ®„ including all 
the points of TP„ wha-e p(E„ | 9o) = 0 and also those of the remaining ones which 
miiBfy the inequality 

(26) S 4* Si M(r2‘s/n{l — r^) — ncrl + 2 

V-i / (Ti 


where the coefficient M is to he found from ike equation 
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d&jims a test 0 } the hypothesis Ho , W)Wc?i is unbiased in ike limit and comsponds 
{in the limit) to the level of significance a. 

Eemauk, The calculation of M satisfying the equation (27) is, of course, 
laborious. But a table of values of M corresponding to varying values of N 
is being constructed by N. L. Johnson at the Department of Statistics, Univer- 
sity College, London, and it is hoped that it will soon be published. 

To prove Proposition I, we must first prove (a) that whatever n, the region 
determined by the inequality (26) satisfies the condition (d) in the definition 
2. The proof is ba$ed on the following Lemma/ 

Lemma. If Fi j - F^ m functions of • :c„ integralh over any 
region in Wn and Wo a region in Wn ^uch that within wo 


m 

(29) ’ n > £ aiFi 

while outside of Wo 

m 

(30) F,<Z aiFi 

U) f as ' ■ ^ am being some constant coefildeniSj then^ whatever may he any other 
region lo in Wn t such that 



we shall have 



Prooj' of PRono3iTiotT L Denote, for simplicity, by p(En) the ele- 
mentary probability law of the X's as determined by the hypothesis tested. 
Comparing the statement of the Lemma with the definition ' (26) of , we 
immediately see that this region has the following property: whatever may be 
any other region m in Wn such that 


(33) 

and 



p{Fn)dxi ■ . . dXn 



p{En) dXi dXn 



(34) 





* J» Neyman and E, S. Pearson: loo. cit., pp, 10-U. 
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we shall have 


(35) 


~[ [ (2 ^( + (S V’f) 

J */Wrt Vi"! \»“1 / / 


But under the Gonditions (i) and (ii) 


» * diVti 


(36) 

p(S„ [ tJ) = 

(37) 

dp(E„li}) 

di^ 

(38) 

S'piEr, 1 (?) 




= 4 = 2 

d=.o yn 1-1 


JoaO \^"‘l yi™! / / 


and it is easily seen that the relations (33), (34) and (35) are identical with 
(11), (12) and (10) respectively and that therefore the region Wn satisfies the 
condition (d) of definition 2* It remains to prove that satisfies also the 
conditions (e) and (f), that is to say that, for ?i. ^ «> , the formulas in the right 
hand sides of (33) and (34) tend to the prescribed values a and zero respectively. 
This conclusion concerning (33) is a consequence of the theorem of S, Bernstein, 
quoted above. To see this, write 

It n 

(39) Uu = 52 - 52 'I'i 

t“l ^“1 

and denote by sq the region in the plane S of (^l, v) defined by the inequality 


(40) w + > Mtri\/n(l — r^) - ncrl -j- r ^ n 

CTl 


obtained from (26) by means of (39), The right hand side of (33) represents 
the probability determined by the hypothesis tested of the satisfying the 
inequality (26). But this is satisfied simultaneously with the variates Ur, and 
satisfying (40) . Therefore, if we denote by Dn the point in S with its coordinates 
equal to (39), then the right hand side of (33) may be interpreted as the proba- 
bility Pli)n c 5 d 1 of Dn falling within Sq . Comparing (21)-(26) with (16), it is 
easily seen that, according to the Theorem of S* Bernatein, whatever may be 
e > 0, if n is sufficiently large, then 


(41) 


PlDneScl 



< € 


where 

(42) G„ = _ “T"/ 

2ir?l(Ti <72 V 1 
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In fact, to what is given explicitly, we must only add that as 

(43) / pixi\9)iki=l 

J-KJ 

the derivative with respect to 6 of the left hand side must be identically equal to 
zero, Therefore 

(44) jg j p(®( i 0) dxi !«_!(, = 

where again the integrals are taken from - « to + w. It follows further that 
the second derivative with respect to B of (43) must be again identically equal to 
zero. Therefore, keeping in mind the definitions of cp; and , we may write 

(4®) ^ = j ('^{ + 'P^)pixi\B<i)dxi = 0 

and 

(46) ^(^"0 « " -or? 

The proof that the right hand side of (24) tends to a with n « will be 
completed if we manage to reduce the integral of (42) over the region so to the 
integral (37) ^ This is easily done by substituting 


j ipipixi I ffo) dxi = = 0 


(47) 

1! 

(48) 

^ + Uffl “ T<TiUlt7l 

(ra'\/n(l — r“) 


Thus, if the coefficient M in (26) and (40) satisfies the condition (27), then the 
value of the integral of (?„ in (41) is permanently equal to a and this means 
that the right hand side of (33) tends to a as n — > m , 

Denote by pi,(u, v) the elementary probability law of u„ and , It will be 
noticed that, whatever s in S 


(49) 


PlDnts] = ff 


pniu, v) du dv 


and that consequently m the course of the above discussion we have proved 
thatj whatever e > 0, there exists a sufficiently large number Nt such that 
n > N, implies 



// 


(Pn(Uf — Gn) du dv 


< € 
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whatever may be the region s in S. We shall now use this circumstance to 
prove that, when n oo^ the right hand side of (34) tends to zero. It will be 
noticed first that 

(51) / ••■ I ■■■ dx„ = / / u’‘p„(u,v)dudv 

J Jwn J 

for k = 1, 2. Further 

(52) n. v)dudv < j j v)d%idv — n<j\ 

Using the inequality of Schwartz/ we may write 
^ j' i4(pu(Wj v) Gf\) dud'X 

< “ Gn\dudv J J IpflCM,!*) - 

Now, it is easy to calculate that 

( 64 ) //. I Pn(u, y) ~ (jn I du dv < 2n(rl 

On the other hand, if n is so large that (50) holds good for any region s in S and 
s+ and s- denote the two parts of where p«('W, u) — Gn is respectively positive 
and negative, then 


(53) 


(56) 


0< / / |pn(W)«) ” = / / ipniUfV) - Gn)dudv 

J 7*0 J 


-/[ 


(PniUj v) - Gn)dudv < 2t 


and it follows that, for such large values of n, 


(56) 


^ J u(pn(Uf v) ~ Gn)dudv < 2<ri'\/€ 

On the other hand, using the transformation (47) and (48), we find that 

(67) — ^ [ f uGndudv=^ - 4 ^ ( ( e^^^^d^dx 

cri\'nJ J«o VStt I J 


and consequently is permanently equal to zero. As e is an arbitrarily small 
number, it follows that 

(68) lim / / upniu, v)dudv = lim 4= / / 2 <Pip{En)dx\ * • • = 0 

y JiC flr-»eo J J&n t"l 

which fulfills the proof of Proposition L 

* See (or examples Kacamarzi and Hv ^Steiuhaua, Theorle det Qcthogonel^ieih&n, 
Warsaw, 193S, p. 10, 
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Phoposition II. If the conditions of Proposition I are satiiified but either 
1 r I = 1 or « independent of Xi, then the test of ike hypothesis Ho which is un- 
biased in the limit and which corresponds, to the level of significance a, is determined 
by the sequence of critical regions , defined by the inequality 


(69) 

wJiere X saiw/tes the equation 
(60) 


Z/ ^ V 




n 




\/27r 

Proof, We notice first that the condition 1 r 1 = 1 and the equation (44) 
imply 

+ <rt)p{xi I do) 


(61) 


or 


(62) 


= j iplpixi I Of) dxi j (^< + fft)‘p(®( I ®o) dx( 0 


j + tfl)p(®( [ 6o) dxi j (^'i + (r5)“p(a!( 1 9ti) dxi 

j <fi^tp(Xi\0a}dXi 


= A yeo 


<Pi(^i + iri)p(a:,- 1 flo) dx{ 


and therefore 

(63) 

(64) 

and finally 
( 66 ) 


j {(^.- + <tI? ~ A,pi{^( + <rj))p(a:, I ef) dXi = 0 

j l¥>i(^'i' + <ri) - Ai/{}p{X{\ do) dXi = 0 


/ 


+ (T? ~ AifiifpiXi [ 9o) dXi = 0 


which means that at almost every value of Xi for which p{xi | do) 0, 

(66) $■( -|- ffj ' = Aipt 

It follows that the inequality (10) in the definition 2 of the test which is 
unbiased in the limit reduces to the following 


(67) 


nf"'jg w)V(j^n I ®o) dxi dx„ 


¥’yp(^n I ^o) dxi • • • dXn 
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owing to (11), (12), (37) and (38). On the other hand, the inequality (59) 
is equivalent to 

(58) (2 <pi) ^ g 4- 5 

with a = xVfn and b ==? 0. Referring to the Lemma, we conclude that the 
regions Wn satisfy the condition (d) of the Definition 2. It remains to show 
that they satisfy also the conditions (e) and (f). This immediately follows 
from the theorem of Liapounoff and the reasoning which we used above m 
order to prove (58). 

If does not depend on Xi then, owmg to (38) and (11), the inequality (10) ■ 
immediately reduces to (67) and the proof of Proposition II follows exactly 
the same lines as before. 

5. Limiting power function. To loiow the properties of a test undoubtedly 
means to know (i) how frequently this particular test will reject the hypothesis 
tested when it is in fact true and (ii) how frequently will it detect its falsehood 
when It is wrong. The information of this kind is provided by the properties 
of the 80 called power function of the test. This has been defined^ as follows. 
LeftiJn be any critical region and, as formerly, PjjSfn atWn | ^) the probability of 
En falling within Wn as determined by a specified value of d. If is fixed, 
then F( e tVn | ^ 1 will be a function of d only* To emphasize this circumstance 
we may introduce a new symbol, writing 

(69) P{En ^Wn\e] - 

which will mean that in the above formula Wn is kept constant and 0 varied. 
The function ^{0 \ wjO thus defined is called the power function of the critical 
region or that of the test based on Wn . If Wn corresponds to the level of 
significance a and Is the value of specified by the hypothesis tested Fo , then 

(70) )3(^l^ [«»«)=« 

and it will be noticed that this is the probability of rejecting when it is in 
fact true. As we reject Ho only in such cases when €'U)„ , the values of 
j3(0 1 'Uip) corresponding to other values of ^ are equal to the probability of 
detecting the falsehood of the hypothesia when 6 has any specified value 
different from . The larger the value of /3(0 | at a given 0, the greater 
will be the ^‘detecting power^' of the test, which justifies the name attached to 
the function ^{B \ -«)„). Until the present time the power function of only a few 
tests has been studied and it follows that we know comparatively little of the 
properties of the tests even if they are in frequent use. The first study of this 
kind was concerned with the power function of the “Student^s’* test os applied 
to the problem of one sample and there are three publications giving various 


* See for example Paul L6vy: Th6orie de Paddition des variables aUatoires, Parie, 
1937, Pp. 101-107. 

’ J. Neyman and E. S. Pearson; loc. cit., p. 9. 
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mimerical tables.^ However, in these publications the tevn'i function’’ 

(Ices not appear yet. Apart from the joint paper already referred to where 
the term ^ power function” was first defined, we may mention a few papers in 
Bmmtrika, the most important of which seems to be that by S. S. Wilks and 
Catherine M. Thompson.® The purpose of studying the power function of any 
test is to be able to answer the following three questions ^ 

(a) What should be the size of a sample in order to have a reasonable chance 
of detecting the falsehood of the hypothesis tested, when the error in the pa- 
rameters that it specifies has some stated value? 

' (b) If in some particular case a test failed to reject the hypothesis tested 
(which, of course, does not mean that it is necessarily true), is it likely that the 
error in % does not exceed some specified limit A? 

(c) Two different tests corresponding to the same level of significance aro 
suggested for the same hypothesis Ho , which shall we use? 

In this last case the answer is obvious-— the one which gives the greater 
chance of detecting the falsehood of the hypothesis tested in cases when it is 
wrong. But to know this we must know the power functions of both tests. 

For the above reasons it seems to be important to study the power function 
of the teat unbiased in the limit aa defined above. It is obvious that^ as in thfe 
case the elementary probability laws are not specified, it is impossible to find 
the actual explicit formula giving the power function. Therefore we shall 
endeavour to find its limiting form. This will be done by means of the two 
following theorems, 

Consider an infinite sequence of situations 


(7i) 


Si , & , . - S 


m , 


In each of these situations we shall have to test the same hypothesia Hq con- 
cerning the probability law p(x | and specifying the value Oo of d. The situa- 
tions differ among themselves by tbe number of the X*b and by the hypotheses, 
alternative to , which are considered. For the situation we shall denote 
them by rim and Hm respectively, We shall assume that Urn *= + «> when 
m ^ oo . As to the hypothesis , we shall assume that the value which it 
ascribes to' the parameter d is 

(72) 

y ^ 


* (1) St Kblodaiejc^yk: Sur l^orreur de la seconde catdgorio le probldmo de "Stu- 
dent.," C, E, Aoademie dee Seianoea, PatU, t, 107 (1033) p, 814, 

(2) J. Ncyman with co-operation of K, Iwasakiewicz and S, Kolodziojozyk: Statistical 
Problems in Agricultural Experimentation. Suppl. Journ, Eoy, Stat, Soo. Vol, II (1036) 
pp. 107-180. 

(3) J. NeymanandB. Tokarakai Errors of Second Kind in Testing "Student's" Hy- 
pothesis. J. A, S, A,, Vol, 31 (1936) pp, 320-334. 

’ S, S. Wilks and Catherine M. Thompson; The Sampling Distribution of the Criterion 

, when the Hypothesis Tested is not true. Biometrika, Vol, XXIX (1937)', pp. 124-132. 
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where the standardized error in 6q , is kept constant. We shall assume that 
in each situation we test the hypothesis Ih by means of the test unbiased in 
the limit and corresponding to the level of significance cx. The power function 
of this test should be denoted by but to simplify the notation we will 

write simply We shall be concerned with the value of this function 

at the point 0 — and we shall prove the following proposition. 

Proposition HI. If the third logarithmic denvalive of ^{xi \ 0) with 
respect to 0 is hounded 


(73) 


3^ log p{x( I e) 
80 ^ 


< C = constant, 


and I r I < 1, then 
(74) lim 


1 

\/27r 



1 

'\/2'ir 


r 

jAf^Nx^ 




dx 


This proposition is analogous to that^® concerning the “smooth” test for 
goodness of fit. It could be used in the following manner. 

When testing the hypothesis Hq and using for the purpose a certain number n 
of observations, wo find ourselves in a situation which might be considered as 
one of the sequence (71)* If n is largCj we may hope that the right hand side of 
(74) will give a reasonable approximation to the actual value of the power 
function corresponding to the value of • 0 to be calculated from (72) by sub- 
stituting in it Utn ™ n. 

Proof. Denote 


(75) 




We may write 
(76) ■ . 


p(xi 1 0„) = p(xi I 




tn 


where di denotes some value intermediate between 6o and dm* Consequently, 
taking into account (39), (47) and (48), we have 


(77) p(S„„ 1 6J = n p(^< I «-») = I 

where 


log (1 + . J 



4“ xr) -{- 



• J. Neyman; ‘‘Smooth’' Test for Goodness of Pit. Skandinavisk Aktuarietidskrift, 
(1937), p. 186. 
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It is seen that> ^ then €,« tends to zero, uniformly in every bounded 

region oi the plane, of % and Denote by s any bounded region in S and by 
Wm(8) a region in Wn^ of which e is a transformation by means of the formulae 
(39), (47) and (48), The probability of falling ^vithin Wvt{^) is equal to 
that of the point with coordinates it and y failing within s. The former of these 
probabilities is represented by the integral of (77) over Wm{^) and the latter 
by the integral taken over $ of the elementary probability law Pm(a5, y 1 $fn) of 
X and y, corresponding to the value 6tn of 0. Owing to the formula (77) we may 
write 

(79) ' p„{x, y]8„) = p^{x, y ) So) (1 4- »? 

where, owing to (78), ??m tends uniformly to ^ero in s as m , Remembering 
the connection between and x, y and also the inequality (B6), which is 
valid for sufficiently large values of we conclude that 





where has the property that, whatever be e > 0, for sufficiently large values 
of m 


( 81 ) 



Qm dx dy 


< e 


where s is any bounded region in jS, It follows that 


(82) p„{x, y ! f),„) = ^ „ J 


and that therefore, whatever be the bounded region s 
(83) lim f [ p„i{x,y\B„)dxdy ^ ^ ff 

J Ja J Js 

It is known however, that whenever an integral probability law tends to a 
fixed limit uniformly within any bounded region, then it must do so within the 
whole space, It follows therefore that the formula (83) is valid for any region s 
whether bounded or not. But 


(M) 

and it follows that 


|3»(«m) = J[ 


j/> 


Pm(x,yle„)dxdii 


4 " 6 © 


(86) ,limWO = ~r 




\/2)r J~” [ \/2 

which completes the proof of Ptoposition III. 


/.I 4 



unbiased tests of statistical hypotheses 


S3 


It is important to be clear about the exact meaning of the Proposition III, 
Suppose for example that in a pai’tieulav case — (yi “ 1 and consider a sequence 
of situations in which 

Til = IQO, ih- 100^, * . * n,n ^ 100'’*, ^ ■ • 

01 “ ^0 “b * 1> 02 == 00 *01, ' ■ ' 0m 00 “h ( ' l)^j * ' * 

If this were the case, then the Proposition III would be applicable and we 
could affirm that the sequence of the power functions ^^(0), each considered 
at the appropriate point 0„, , has a limit, represented by the double integral in 
the right hand side of (85) with t?o-i = 1. Accordingly, if we were interested 
in the value of the power function at 0' =*= 0o + -02 with n = 10000 and 0i == 1, 
then we could hope to obtain its approximate value calculating the double 
integral in (86) with 

(87) - (0' - 0o)Vn = 2 

These are legitimate conclusions, However, it would be wrong to consider as 

proved that, if in the same example we increase the size of n to n' = 40000, 

then the value of the power function at 0 = 0^ will be represented by its limit 
(86) with d ^ 4 and with about the same accuracy as previously. It is just 
possible that to attain the same accuracy at = 4 a value of n greater than 
n' will be needed. This of course would imply a corresponding change in 6', 
Proposition IV. If the conditions of Proposiiion III are satisfied hut 
eti/icr 1 r 1 = 1 or u indepmdeni o/ 

(88) lim Mm) = 1 — ^ dx 

The proof of this proposition is quite analogous to that of Proposition III. 

' 6. Examples, 

Example L Consider the case where it is known for certain that 

(89) = for-cc<.<» 

but where the actual value of 0 k doubtful and it is desired to test the hypothesis 
Hq that .0 ~ 00 “ 0, the alternative possibilities being both 0 < 0 and 0 < 0. 
Before applying the test unbiased in the limit it is natural to try the unbiased 
test of type A. The critical region of this test is defined by the inequality 

(90) S ^ + 5 X) 

where the constants a and b must be found so as to satisfy the conditions 

(91) 

(92) f ■ ■ ' [ T) ifitP(En\6o) dxi • ' ■ dx^ - 0 

J ,/Wo 
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The technical difficulties involved in this problem are considerable and this 
may induce us to apply the test unbiased in the limit. Following the above 
theory we have 


(93) 


>l>i = 


2X!i 

iTa!? 


(94) 

(95) 


ix] ^ 

(1 + »’)* ™ 1 + *? 

= - Of _ 12(ai.- - B) 

(1 + (Xi - fi)^)’ (H-(s<-W 


It is easily seen that all the limiting conditions of the theory are fulfilled and 
that, in particular 1 Xi(0) I cannot exceed a fixed limit, approximately equal to 3. 
We have further 


(96) 

Similarly 

(97) 

(98) 







S\a 


(1 + Xi) 



2 


g|$, + = f = 


®(ipi^() = 0 = r 


It follows that the regions iS„ , the sequence of which determines the test 
which is unbiased in the limit, ate defined by the inequality 






1=1 X \i«l -|- X{/ r ® ^ 


where M should be calculated so as to satisfy (27) with 

(100) N = 

In order to test the hypothesis /fo we have therefore to observe the values 
fiCi f . • ■ Xn and to substitute them into the left hand side of (99). If the 
inequality is satisfied then the hypothesis should be rejected. 

Approximate values of the power fuivoUon covild be obtained from the right 
hand side of (85) with 

(101) = ey|. 

ExiMPiiB -IL Let ns assume as given that 

p(xi'|6) = ee^"' forO < *,• 

= 0 elsewhere 


(102) 
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with 5 > 0, the hypothesis to test being that 5 == = 1, with the alternatives 

both 0 <l and 0 > L 

In this paTticular example the unbiased test of type A is easily found^^ and 
moreover^^ it has also the property of being of type Ai , But this circumstance 
does not diminish the illustrative character of the example. We have 

(103) 


(104) 


= — 1 = constant 


It follows that the regions forming the test which is unbiased in the limit are 
determined by the inequality (59) . Wo have further 


(105) (t\ “ ®(9?i) ™ J (1 — — 1 

and the inequality (59) reduces to 


(106) 


z 


(1 -- Xi) 



with X taken from the tables of the normal integral according to (60) and to the 
chosen value a. Approximate values of the power function can be calculated 
from, say 

(107) PM - 1 - ^ f dx 

V 27r 

with 

(108) l)Vn 


The simplicity of the example considered permits to calculate the exact 
power function of the test and it may be interesting to obtain its limit ^oa(^) i*^ 
another and a more direct way, Write 

n 

(109) llsi = y 


It is known that, if the probability law of each of the X^s is given by (102) 
then the probability law of y is 


(lio) 


p{y\6) = 


P y 

(n-- 1)! 


for 0 <y 


— 0 otherwise 


J, Neyjnan and E, S. Pearson, loc, cit, p. 18 et seq. 

J. Neymau: Estimation statiatique traitSo eomtne un probl^mo do probabiliU olaaa- 
iqUe, Series ActUaUt6a aeientiftqueB et induatriellcs. Paris, (19S8). (In the prese.) 
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It follows that the exact form of the power function corresponding to the test 
(106) is 

An pn+X’y/n 

(111) /...Vi 


For values of n about 100 or more and for the values of 0 close to unity the 
distribution of say 


( 112 ) 


n _dy 


n 


\/n 


y/ n 


is practically normal with mean equal to zero and S-D. equal to unity. It 
follows that the integi'al in the right hand side of (111) is practically equal to the 
normal integral taken within the limits which are obtained by substituting in 
(112) tho limits of y in (Ul)r After some easy transformation we have, with a 
considerable accuracy 


(113) 


i 15„) r. 1 


\/27r 




dz 


or, after some further transformations and taking into account (108) 


(114) 


j9(&|^Z),) - 1 


1 

■\/2ir 


\/f^) 




and it is seen that, when d is fixed and n indefinitely increases, then ^{0 | iD„) 
does tend to 


Ukivursity College, London, 



THE TRANSFORMATION OF STATISTICS TO SIMPLIFY THEIR 

DISTRIBUTION* 

By Habold Hotelling and Lebteb R. Frankbl 


1. Introduction. The custom of regardmg a result as sigirificant if it exceeds 
two or three times its standard error has now given way among informed statis- 
ticians to a consideration of the exact probabilities associated with the distri- 
bution of the statistic in question. For example, in such problems as that of 
examining the significance of the difference between the means of two samples, 
particularly small samples, it is no longer adequate to regard the difference of 
means, divided by the sample estimate of its standard error, os normally dis- 
tributed, The significance of this ratio, “Student’s ratio,” is judged instead by 
the value of 


( 1 ) 

where n is the iiumber of degrees of freedom entering into the estimate of 
variancej and 



If the probability law underlying the observations themselves is normal, and 
they are independentj P is the exact probability of the value of i obtained being 
equalled or exceeded on the hypothesis that there is no real difference between 
the means. 

Methods of approximating P have been studied by E. A. Fisher* and by 
W. A. Hendricks/ and tables have been presented by Student^ and Fisher.* 
Nevertheless, the practical statistician will very frequently wish to make 
judgments of significance without stopping to consult a table, or laboriously to 
compute P, and will tend to revert to the former inaccurate but convenient 
practice of treating t as normally distributed with unit variance, The essential 

* Presented at the joint meeting at Indianapolie of the American Mathematical Society 
and the Institute of Mathematical Statistics, December 30th, 1037. 

I Expamion of Student Integral in Powm of n“h Metron, vol. 5 (1925) » 

^ Annals of MBthematical Statistics, voL 7 (1936), pp, 210-221, 

® New Tables for Testing the SignificaT^ce of Observations, Metron, vol. 5 (1926). 

^ M^ihod^/of Research Oliver and Boyd, 1925-1936. Tables IV and 

VI, 
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reason for this is that the normal distribution to which that of t approximates 
for large values of n has only ojie parameter in the expression for the probability. 
Henco it is easy to remember a few important values, such as those correspond" 
ing to = .01 and . 05 ; and when values of T representing other levels of sig-- 
nificance are jn question, the single-entry tables of the normal probability 
integral are more easily available and easier to use than the double-entry table of 
Student’s integral. Indeed, i is a more useful statistic than Student’s original 
ratio of mean to sample standard deviation, to which it is in the simplest case 
proportional, partly because of the close approximation of i for large samples to a 
normally distributed variate of unit variance. 

For more complicated statistics the practical need for something simpler 
than the exact distribution is even more urgent, on account of the larger number 
of parameters involved in the distributions. For example, the large class of 
problems giving rise to probabilities expressible as incomplete beta functions 
require for exactitude the use of Pearson’s extensive triple-entry tabic, ^ and 
even this is inadequate for some ranges of the parameters. The shorter tables of 
It. A. FisheP and of Snedecor’ are helpful, but are also necessarily of triple entry. 

It is a common practice, for example, among economists and psychologists, to 
Select either by graphic methods or by preliminary calculation that one, out of 
many tests that might be applied to available data, for which P is the least. 
Such selection evidently introduces a bias, which is the more subtle because the 
tests giving high and therefore insignificant probabilities are likely to be for- 
gotten. Often the only way to guard against such fallacies is to insist on a 
value of P lower than is easily determined from tables. Thus, if h independent 
tests of significance have been made, and only the smallest value P ia reported, 
its significance should be judged not by this value P itself, but by the probability 

P' 1^(1 pf^ JcP 

of the least value being so small. If we equate P' to some such standard value 
as .01, then P must, for this standard level of confidence, take only a fraction, 
approximately 1/fc, of this value. Such a small probability will often fall 
outside the range of existing tables. 

Instead of relying on tables or direct computation from the exact distribution 
of a statistic, it Avill sometimes be desirable to use a modification of the statistic, 
selected so as to have the normal or some other standard distribution, We 
shall consider a type of transformation of a statistic such that the distribution 
becomeB the limiting form of the original distribution as the sample size increases. 
Thus our transformation will reduce to the application to the statistic of a cor- 
rection which will be small when the sample is large. We shall show how to 
make simple approximate corrections of tliis character for two cases. 


^ Tafclss ef ihe Inco?nplele Beta Fundion, Biometrika Office, 1934, 

® hoc. cit, Tables IV and VI, 

^ Calculation and Ifttcrpfeiui^oJi of Analysis of Vana 7 ws and Covariance. Ames, Iowa. 
Collegiate Press, 1934. . . 



distribution of statistics 


89 


The first of these is the Student ratio t, the lower limit of the integral in (1), 
Putting 



which in view of (1) and the fact that the integral of each distribution from - oo 
to CO is unity is equivalent to 


( 6 ) 



we shall show that x has an asymptotic expansion ; 

/ __ + 3 _ 35i;* + 19t^ + - 15 

* 1 4n - 9671“ 384w® 

627lf + mu'" ~ 102{' - 1680i’ - 945 
92,1 60»< 

It will frequently be a sufficient approximation to treat 



as normally distributed. These appear to be approximations of practical 
value when n>t^. 

The second statistic whose transformation to a function having its limiting 
distribution we shall consider is the generalized Student ratio T, appropriate 
to all the uses to which t can be put, but with a multiplicity of variates instead 
of one to serve as the basis of the test of significance,® This is defined with 
reference to variates aij , ■ ^ ^ Xp , together with a linear function of sample values 
(proportional for example to the difference between the means in two samples), 
such that if is the value of this function of the sample values of (f ... ^ 
p) then the variance of in the population sampled is the same as that of Xi , 
and on the hypothesis to be tested, the population mean of each is zero. 
In terms of unbiased quadratic estimates of the covaxianees o-t,* among 
Xi , > ^ • f Xpf each based on n degrees of freedom, we may define lij- as the cofactor 
of Si/ divided by the determinant of the statistics Si/ . Then T is defined by 

( 7 ) 



^ Harold Hotelling, The Generalization 0 / Slndent^^ Ratio, Annals of Mathematical 
Statistics, vol. 2 (1931), pp, 360-378, 
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the siiiRttifl.tioRS ruufling indcpcndciitly with respect to i 9 .nd ^ fiom ^ to p, 
For indepeucleiit sivmples from a multivariate normal populatioiij the distribution 
of T haa been shown® to be 

As 71 increases, the distribution of T approaches the x distribution with p degrees 
of freedom: 

( 9 ) 

By equating the probabilities derived from these tn^o distributionsj we shall 
define x as a function of and obtain asymptotic expansions for the functions 
X and thus defined. 

Since the probability associated with T is expressible in terms of the incomplete 
beta function, or the analysis of variance distribution integral, it follows that 
any of the many common statistics, of which simple functions have this distri- 
bution, can be expressed simply in terms of T, Teats of significance in a wide 
variety of eases may therefore be made with the help of the asymptotic expan- 
sion corresponding to together with a table of 
A further advantage of the transfoxmation of a statistic into a norm ally 
distributed variate of unit variance and aero mean is that further statistical 

I 

tests are possible with sucli variates. Since a great part of statistical tlieory is 
based on the assumption of such normal distributions, an extensive field of 
applications becomes available in this way. For example, if several independent 
tests give values of t based on various numbers of degrees of freedom, and it is 
desired to combine these tests so as to get a single probability, the corresponding 
values of the normally distributed variate x defined above may be squared and 
added. The sum will then have the distribution, with a number of degrees of 
freedom equal to the number of values of i used. In a similar manner, the 
values of corresponding to a number of independently determined values of 
may be added, and the sum will have the distribution with a number of 
degrees of freedom equal to the sum of the various values of p involved, 

The advantages of this type of what may be called “normalization^* of a 
statistic have been brought out by R. A. Fisher for the particular case of tlie 

correlation coefficient. His of ^ log facilitates such operations 

as the averaging of values obtained from independent samples, or taking the 

“ Harold Hoteling, loo. cit, 

SlaluHcd Meihods for Research Work^rs^Qea. ZB, 
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difference between two values, with the testing of significance of the result in 
each case. This is because z, unlike r, has a nearly normal distribution, with 
variance nearly independent of the population value. We note in passing that 
this function is the same as tanh'^V, and may therefore he determined accurately 
and readily from the Smithsonian Institxition Tables of Hyperbolic and Ex- 
ponential Functions, 

2. Normalization of t. The ^'duplication formula” in the theory of the 
Gamma function^ shows that 

I ^ 

Substituting this in (2) and taking logarithms we have: 
log ^ log n - (n — 1) log 2 + log r(n) 

-2logr(|)-!L±ilog(i + l) 

The last logarithm may be expanded in a series of powers of z^/n which not only 
converges uniformly on the interval 0 < ^ < i when n > but has the property 
of being a mijornl]! asymfioiic representation of the function on this interval. 
This means that the sum of the firstj terms of the series {j = 0, 1, 3, * • ■) differs 
from the fvmeUow lepresewted, by a quantity whose product by has, for 
sufficiently large values of ft, an upper bound independent of 2 , so long as z 
remains in this interval. Uniformly asymptotic series have a number of 
important properties, among which is^^ term by term integrability with respect 
to z, In this sense we have the uniform asymptotic representation: 



We shall obviously have another uniform asymptotic representation if we add to 
this, term by term, asymptotic series with terms independent of 2 , such as those 
for the gamma function logarithms in (10). Since^’ 

(12) log r(B) ~ ^ log 2it + (7i - I) log n - ?1 + 2) : (2T - ' 

where 

— i) Ba — ;g'V) -^3 ^ A, ^4 =* ^ 6 = ‘ • 


Whittaker and Watson, Modern Analysis, 4th ed., p, 240. 

** H. Schmidt, BeiiT(ige zu eine Theorie der <dlgeminm a&yiaptotischen Darsiellungen. 
Math. Annalen, vok 113 (1937), pp, 629-656, The property mentioned above is proved in 
Sehmidt*B Theorem 6. 

Whittaker and Watson, loc. cit., pp. 252, 126. 
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are the BeraouUi numbers, we obtain upon substituting in (10) this and the 
similar formula for log r m , together with' (11), and some simplification, 


(13) 


log ^tt(«) i log 2»- ~ - H 


32' - 22® 1 ^ 42® + 32® 62® ~ 42*“ 

*T” -rrk .0 'T' I JA-^l l” 


12n2 


24?i^ 




Upon differentiating (5) obtain: 
(14) 


^(®) I = Ut) 


Since simply the normal distribution function (3), this may be written : 
(16) ^ log Stt - I + log ^ ^ log ^^(0 


We. shall always in this paper use the symbol ^^lim^' to mean the limit as n 
approaches infinity* The functions of n and or of n and which we shall 
denote by 22, 22'', with or without subscripts, arc to be such that the absolute 

value of each has an upper bound independent of n, z and t so long as n > 1, 
and z and t are confined to some fixed finite interval. 

*Ftom (15) we he.ve the.t lim log <|i„(i^) log <f>(i!:), 

whence, by the continuity of the exponential function, 


lim = tj>(5^) 


This holds 'uniformly for 0 < ^ < t 
(5) we therefore find that 


Subtracting f 


Jo 


(j>(z) dz from both sides of 


(16) 



^(z) iz ^ 


liiniz) - (t>(z)} dz 


can by choosing n Urge enough be made as small as we please. Since <j>iz) > 0, 
it follows that the function :c of t and n is such that 


(17) lim a; = L 


A parallel argument, proving slightly more than (17), is the following. From 
(13), 


f?f 

\0g^rv{z) - \0g(l>(z) + — 

n 

where 22' is a bounded function of the kind described above. Therefore 
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Substituting this in (16) we have that 


rx , p 

/ <j){z) dz ^ - 4>[z)R*^ dz 

h U JQ 


From the mean value theorem of integral calculus it then follows that 
(18) 


i + ^ 
n 


All asymptotic series may be substituted in a power series, and the result is a 
valid asymptotic representation of the corresponding function. (Schmidt, 
loc. cit., Theorem 4.) This justifies taking the exponential of each side of (13) 
and arranging in a series of powers of to give 


(19) 


<PM) ~ ^(2)(l + ^ 

( u ) 


This asymptotic development will, like the original one, hold uniformly in 
every finite interval, and may therefore be integrated term by term. . Thus 


(20) f ^n(2) dz = f ^(.z){l + + . . . + 


n 


n® 


«j(^) 




where liiJy+i | has an upper bound independent of n and t when > 1, and t is 
confined to a finite interval, 0 < i T, Substituting this in (16) we obtain; 


( 21 ) 


<^(«) dz - f + . . . + 


dz + 


^/+i 


( 22 ) 


n 

V - \ f 

In terms of a sequence of functions /j ,fi, of < to be defined bcloWi let 

fi 


^ - / 4- -/i 4- 4. 


+ 


rV 


f 




Now j 4>(z} dz can be expanded in a series of powers of n ^ which converges for 
sufficiently large values of n; for the Taylor series 


(23) 0 ( 2 ;) = 0(i) + (^ - 0 0'(O 'I 

can be integrated to give a series of powers of a;,- -- which by (22) is a poly- 
nomial in As a matter of fact we have from (22) that - i can be made 
arbitrarily small by taking n largo enough; consequently the series (23) and that 
obtained by integration in this way will converge uniformly and absolutely. 
We thus have; 


( 24 ) 




(j){z)dz — 2^^^^ 
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Now let us define /i , /a • • • , by equating the coefficient of each power of n 
in (24) to that of the same power of n in the right member of (21). This process 
gives a sequence of equations 

fiip - <l>(^)(Xi(z)dg 


(26) 



<if(z)a2(2i) di 




<^{z)ci${z) da 


M + ihh + i/aV + 


^(«)q:4(^) dz 


Since 5 «^ 0 the first of these equations defines /i for every value of t; when ft 
has been determined, the second equation defines fz ; then the third defines , 
and so forth, It is to be observed that the functions/j , /a , * * • thus determined 
are not changed when the value of j appearing in (22) is increased; we liave a 
unique sequence. 

If for the right-hand member of (16) we substitute that of (13), replacing 
u by t, and on the left of (15) put 


X s= 


dt 


^ + n + + 

1 x^l X ^ 4, 



and then expand in a formal manner in powers of n^\ we shall upon equating 
coefficients of like powers of n obtain a sequence of differential equations 

/(-</> = i(-l - + <‘) 


(26) /; - Ift = i/i’ + if\ + 


These, with the initial condition /i = ft = • • • = 0 for f = 0 determine the same 
sequence of functions as before. The equations (26) are in fact obtainable 
simply by differentiating (26) and cancelling out the factor (/>({), That this 
must be true follow from the equivalence of the various formal processes of 
manipulatmg series of powers of n~\ whether convergent or divergent, to give 
equivalent results. The differential equations are easily solved; the solutions, 
at least for /i , /j , /s , and ft , are all polynomials. Why they should come out as 
polynomials is not immediately obvious; but their calculation is made easier U 
each/; is replaced in the differential equations by a polynomial of degree 2J -f- 1 
with undetermined coefficients, involving only odd powers of t. The f s of lower 
order are replaced by values previously determined, and the coefficients are 
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found by equating like powers of t. This process supplies at each stage more 
equations than unknown ooofFicieiits; their consistency verifies the assumption 
that ft is a polynomial of the kind specified, at least for j < i. These poly- 
nomials arc the coefFicionts of tlic powers of rT^ in (6). 

The series on the right of (24) not only converges but is an asymptotic series 
uniformly valid when i varies in any finite interval. Hence upon subtracting 
(24) from (21) and taking account of (25) wc find that 



^{z)dz 




where [ | is uniformly boujidecl Upon applying the mean value theorem 

to the integral on the left we find that x differs from xj , and thus from the first j 
terms (22) of the series (6), by a quantity whose product by remains bounded 
when n approaches infinity. Tliis proves the validity of the asymptotic ex- 
pansion. 


3. Accuracy of the Approximation, To follow through the above processes 
in such a way as to obtain useful limits for the error involved in using the first 
few terms of the series (6) in ])laco of x would bo excessively difficultt However, 
the magnitude of the error in taking the first two or three terms as an approxima- 
tion to X may bo judged from the tables below to be adequately small for practi- 
cal purposes, provided 7i > The essential singularity of the normal distri- 
bution at infinity, in contrast with the algebraic nature of the Student dis- 
tribution, means a poorer approximation of ono to the other ns i increases while n 
remains fixed, though a better approximation as n increases, This is illustrated 
in the following tables, where it will bo observed that the approximations are 
better for large tlian for small values of n, and of 

P = 2 [ " <i>(s) £/« = 2 

It will be seen that for n = 10 and P < .001, the utility of the asymptotic 
series, or at least of its first five terms, is vitiated by the rapid oscillation of 
conseeutive terms, due to the high values of in relation to n. 




1,812 

1.618 

1.65Q 

1.643 


1.607 

1,642 

1,646 

1.645 



.06 

P ^ 

.01 

n ^ 10 

n » 30 

n « 10 

n “ 30 

2.228 

2.042 

3,169 

2.760 

1,896 

1,954 

2.294 

2.664 

1.08Q 

1.060 

2.764 

2.879 

1.963 

1.060 

2.446 

2.675 



1,645 


1.960 


2,676 
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1 P .001 

P = .0001 

1 


ss 10 n ** 30 

a 10 n ^ 30 » = 100 

t 

4.587 3.646 

6.22 4.482 4.052 

.Di 

2.069 3.212 

.05 3.69 3.88 

.72 

4.981 3.313 

12.86 3.98 3.89 


0,896 3.283 

-20.44 3.85 3.89 

Xi 

7.163 3.293 

75.66 3.91 3.89 

X 

3.291 

3.891 


t 


4. Transformation of the Generalized Student Ratio. The arguments and 
methods of calculation set forth b Section 2 may be applied with little or no 
change to the transformation of various other statistics in such a way that the 
liiuitmg distribution for large samples is reached at once for the transformed 
statistic. In particular, to deal with the generaliised Student ratio T, we may 
equate (8) to (9), represent x as an asymptotic expansion with undetermined 
coefficients which are functions of T, and then by substituting and equating 
like powers of ?r‘ obtam as before a sequence of differential equations for 
determining the coefficients. This process gives 

m ,..T I (8 - + 0 + WT* + IS?* 

This reduces to the expansion of x in terms of I previously found if we put p « 1 . 

It is somewhat more convenient in practice to use x* and T , to avoid extract- 
ing the square root of the latter expression, and to utilize the existbg tables 
of x^ Ordinarily therefore we should not use (27), but the series 

+ , (4 ' pH (2 + 85^ \ 

^ i 2tt 24n« "7' 

which may be obtained in the same way, or by squaring (27) in a formal manner. 
That these are genuine asymptotic approximations follows by essentially the 
same argument as before. 

Columbia Umivebsity and Washimoton, C. C. 


ON COMBINED EXPANSIONS OF PRODUCTS OP SYMMETRIC POWER 
SUMS AND OP SUMS OF SYMMETRIC POWER PRODUCTS 
WITH APPLICATIONS TO SAMPLING (Continued) 

By Paul S, Dwyeh 

PART 11. THE FUNDAMENTALS OF SAMPLING 

Introduction 

We consider a population of N variates in which every individual possesses a 
common attribute, Let the variate Xi be the measure of such an attribute for 

fN\ 

individual i From the N variates it is possible to form t 1 different samples 
where each sample consists of n variates, n <N. 


N 


n 


means. 


T 

n 


Each sample has its mean, variance, etc, so that there are 
variances, etc. The fundamental sampling problem, as interpreted here, is to 
find the relation between the moments of the f ■" ) means, and the moments of 

\y 

the I ) variances in terms of the moments of the moments of the universe, 
\n/ 

Numerous attempts have been made to solve this problem, but each has been 
restricted in some way. It is the aim of Part II to indicate hn approach which is 
broad enough to include many of the fundamental variations. 

The first chapter is devoted to a listing of criteria which should be satisfied 
by a theoretical development which is to be considered sufficiently general. 
These criteria might be applied to other statistics but the theory developed 
here is limited to those statistics which are moments (or functions of moments) of 
moments. The first chapter continues with an account of the more significant 
papers which have contributed to a general solution of the problem. No attempt 
is made to indicate a complete history, but rather there is presented a brief 
summary of a number of the most significant contributions, 

The second chapter is devoted to definitions and notation. An attempt has 
been made to use conventional notation whenever it is, suitable, 

The third chapter deals with some of the fundamental principles which are 
used in the general approach, It presents a crucial part of the argument 
as it shows how various types of sampling problems can be reduced to Carver 
functions, 

The last three chapters deal with specific applications to some of the simpler 
problems. Chapter IV discusses the case of moments of the mean of the sample. 
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Chapter V considers the mean of the variance and the variance of the variance, 
while Chapter VI gives a large number of formulae, implicitly, in tabular form. 

Chapter I. A Brief History of Previous Contributions 

In order to assist the reader in getting a perspective with reference to previous 
mathematical work on the relationa between the moments of the moments of 
the sample a-nd the moments of the complete set of measures (universe) > a list of 
criteria* is suggested below which might be applied to each contribution. These 
criteria group themselves naturally into two classes, The first eight questions 
can be answered categorically, while the remainder are less definite in nature 
and arc not so subject to categorical answers, 

1. The Criteria. 1, Does the method apply to one type of frequency distri- 
bution only or is it broad enough in scope to mclude any disiributmn law? 

2. Is there any restriction as to the siae of the sample? 

3. Is there any restriction as to the size of the universe? 

4. Is there any restriction as to the nature of the correlation between ob- 
servations? More specifically^ is the method applicable only to some particular 
law of formation of the sample such as '^drawing with replacements/* ^'drawing 
without replacements,’’ etc., or is it broad enough in scope to allow application 
to other orderly replacement laws? 

5. Is the application limited to one characteristic (variable) or can a large 
number of characteristics be treated simultaneously? 

fi. Is it necessary that the univerao maintain the same frequency distribution 
during the formation of the sample or may it assume a different frequency 
distribution before each drawing? 

7. Does the method produce exact, rather than approximate, formulas? 

8. Does the method permit approximations to a required degree of accuracy? 

9. Does the method enable the author to write general laws in a compact 
form? More specifically, can he express, in a form which is not too symbolic, 
any moment of a given sample moment? If not, what order of moments can 
be expressed? 

10. Is the notation such that the general case can be turned into the more 
important special cases with relative ease? 

11. Does the development lead logically to the introduction of new moment 

functions (such as the semi-invariant of Thiele IB'; 209] or the k functions of 
R. A. Fisher which ate useful in condensing the lesultB? 

12. Is a combinatorial analysis provided so that any given formula, or any 
part of it, can be checked for accuracy without too much effort? 

2. Review of previous results. The articles below have been examined with 
the criteria in mindt No attempt is made to write specific answers to all the 


tA these oriteria havfe been suggested, in less explicit form by Tcliouproff (16; 
46M71), The ‘/Introduction** of his Matron paper is recommended for use as a supple- 
ment to the preaentr chapter. 
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criteria in each case, but rather to indicate the important features of each 
contribution. 

The papers discussed by no means cover all the work on moments of moments, 
although a rather complete bibliographical background is available to the reader 
who desires to examine the bibliographies attached to the articles mentioned. 
Undoubtedly the importance of the articles written in English has been over- 
emphasized. Since the important contributions of non-English writers {sucli as 
Thiele and TchouprofP) have eventually appeared in English, it does no serious 
harm to refer to the English versions even though the results may have been 
partially antedated by the author in some other language. 

A large number of the earlier results on moments of moments were limited to a 
special case of the problem, usually the case in which the universe is infinite 
and normal. The present sumnaary deals with those authors who, during the 
past four decades, have made real contributions to the problem of generalization. 
A detailed account of the history of moments of moments would include many 
valuable contributions which are not included here. 

It seeme expedient to start with Pearson's article the Probable Error of 
Frequency Constants" [2] which appeared at the opening of the century. 
Although by no means the first article in the field, it presented a rather complete 
set of formulas for the case of moineuts of moments. One advantage of these 
formulas is that they are relatively brief and yet this brevity results from the 
fact that they are approximate. The original paper dealt with the univariate 
case, but it was followed by a later one [6| whiqh discussed the case of more than 
one variable. 

These formulas have played an important r61e in that they have assisted in 
making it clear that the moments of moments of samples must be estimated If 
one is to be permitted to draw conclusions from his sampling moments and that 
it is possible to work out formulas which serve as the basis of those estimates. 

Of great importance also was the contribution of T. N. Thiele to the sampling 
problem. Adapting certain ideaa of Laplace, he used semidnvariants in which 
to express his results which he published in English in 1903 in ^^The Theory of 
Observations" [B^; 309]. He took the case of the infinite parent and any law of 
distribution and then worked out moments through the fourth of the variance. 

An earlier contribution of the introductory period was that of Karl Pearson 
in 1899 [1], This paper is significant in that it provides formulas for the four 
moments of the mean when sampling is from finite universe. The universe is 
not general, but obeys a simple frequency law. 

Another article of this period was that of Robert Henderson (1904) in which 
the first four moments of the mean were given for an infinite universe with any 
frequency law, This article, which was first published in Transaclions of the 
Actuarial Society of America [3], was considered so important that it was re- 
published in 1907 in the British J ournal oj the Jnstituie of Actuaries, Henderson 
gave, in addition to the first four moments of the mean, first moments of nia , Ws , 
THi although the last of the.se formulas is erroneous. 



100 


PAUL S, PWYJGR 


Another important contribution of this period was that of * Student*' in 
190S [5]. He was interested in the properties of the normal distribution, but 
did not assume normality in his general derivation. He took an infinite popula- 
tion and wrote the formula for the variance of the variance. In this result he 
inserted the condition for normality. His further argument in the normal case 
implied the development of corresponding formulas for the higher moments of 
the variance, but he did not publish them as they were incidental to his main 
attack. The semi-invariant equivalent of these results had been previously 
given by Thiele [B^; 209'-2l0]. 

The real contribution of “Student'* to the general problem of moments of 
moments was his method, for it is his method which has been utilized by later 
writers. “StudenVs" method has the advantage that the development involves 
algebraic processes only. Contributions of Neyman, Church, Pepper, Caiwer, 
and the present writer are based upon it. 

An important development during the next decade, 1908'! 918, was the 
establishment of the first four moments of the mean when the samples were 
drawn from a finite parent without replacement. It appears that a number of 
men worked this problem independently. I’or example, one might examine the 
results of Pearson [4], Isaerlis [7, 8], Mortara [C], Tchouproff [11], and Edge- 
worth [9], probably the best English presentations of that era were those of 
Isserlis (8) and Edgeworth [9] which appear in the same volume of the Jourml 
of the Royal StaiisHcal Soeiety. 

A most prolific writer on sampling during the next decade was the Rusaiau, 
Tchouprofi, who bad been publishing in Russian and Scandinavian journals 
[10], [11]. His most valuable contributions were published in 1918-1923 in 
Biometrika (in English) and in Melton (m English)/ 

The first series of articles was published in three different numbers of Bio* 
minH in the years 1918-19 [12]. Tchouproff assumed an infinite universe 
and used the method of mathematical expectation. At first glance the most 
characteristic aspect of his work appears to be the complicated notation which 
he used. This notation was adopted because he undertook a much more general 
problem than had previously been attempted and hence needed to make new 
distinctions. Although he limited himself to the infinite ease and one variable, 
he worked out the theory with the freedom that the frequency distribution of the 
universe might change between drawings, lu the special case in which the 
populations are the same, he worked out the moments of the variance as far os 
the fourth. The chief criticism of his work concerns the complicated notation 
which seems to have been difficult to follow critically. A mistake in one of hia 
formulas wa5 not discovered for some yearn and then not by examination of his 
reasoning, but through the application of his results to an actual problem [17], 

It is perhaps appropriate to insert here that in 1934 Feldman [30] rewrote the 
material of the second Biomeirika article by simplifying the notation and extend^ 
ing the argument to the case of two (and more) variables. 

Tchouproff continued to generalize his work and in the 1923 volume of Meirm 
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[15] there appeared a series of articles ia which there were no restrietions as to 
the size of the sample, uo restrictions as to tho type of aampUng distribution 
(ia fact the sampling distribution might vary between successive drawings), 
and no restrictions as to the law of replacement, or more generally as he expressed 
it, ‘hio restriction as to the nature of the correlation between observations/’ 
Ciiterion number 5 is the only one of the first eight criteria which is not satisfied 
in as much b.h the approach is limited to that of a single variable. Also tho 
notation was extremely complicated and, although Tchouproff gave general 
formulas for moments of moments, these formulas are so symbolic in form that 
he did not find it expedient to write out specific formulas beyond the variance 
of the variance for such an important special case as sampling from a finite 
parent without replacements. 

During the same period J. Splawa-Neyman [14] had been examining the 
problem of sampling from a finite parent without replacements. He published 
his results in a Polish journal in 1923 [14] and his corrected results two years 
later in Biometriha [18], He gave the well known formulas for the first four 
moments of the mean and a formula for the variance of the variance. He also 
gave some simple correlation formulas such as the correlation between the mean 
and the variance. 

At this time the basic problem of moments of moments, at least as it was 
interpreted by Pearson and his followers, was the establishment of the first four 
momeiits of the given moment of the sample so that a Pearson curve could be 
fitted. A, E, R, Church, a worker in Pearson’s laboratory, was assigned the 
task of seeing how the moments of the variance work out in actual practice. 
In doing this he became convinced that the formula for the fourth power of the 
variance, which had appeared in Tchouproff’s Biom^rika article, was incorrect, 
He tried to follow the argument of Tchouproff, but apparently was baffled by 
the complex notation and finally, at the suggestion of JPearson, decided to carry 
through the formula using the method of "Student," In doing this he dis- 
covered a mistake in the Tchouprofi formula for the fourth power of the variance. 
At the same time he published [17] the formulas for the third and fourth power 
of the variance in the more conventional notation of that time. 

It might be noted that it is jmrticularly fitting that Church should discover 
this error since Tchouprofif, as Pearson himself stated in an editorial [13], had 
pointed out a number of errors made by the Pearsonian school, 

In the next volume of Biomeirika there appears an article by Church [19] in 
which, among other tilings, formulas are derived for the third and fourth 
naoments of the variance in the case of a finite population, sampling without 
replacement. Church claimed no particular credit for these formulas. His 
point is rather that they are almost valueless from a practical standpoint chiefly 
because of their length. The formula for the fourth power of the variance 
occupies three and one-half of the large pages of Biom&tHka and is given with 
the apparent aim of indicating, as Pearson said [21; 209], “the practical futility 
of the theoretical formulas." 
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Church gave full credit to Neyman for the formula for the variance of the 
variance and made no mention of Tchouprotf s il^c^ron work and of the more 
general presentation there given* This was particularly unfortunate because 
it exposed him to the charge that he ignored non-English authors. This charge 
was immediately made by Greenwood and Isserlis [20] who broadened it to 
include Neyman and^ by implicatioiij Pearson himself, They advocated the 
case of Tchouproff who, now dead, was unable to defend himself* They gave a 
survey (valuable to the cursive reader) of the pertinent contributions of the 
Tchouproff articles and suggested that the ignoring of Tchouproff was par- 
ticularly disconcerting since it appears that Tchouproff had gone more than half 
way in his cooperation with English writers. 

Pearson replied in an interesting article [21] which made it clear that Neyman 
established his results mdependcntly of Tchouproff and that the language of 
Neyman is much simpler than the complicated notation of Tchouproff. Pearson 
emphasized that Tchouproff made no attempt to give specific formulas for the 
third and fourth moments of the variance in the case of sampling with replace- 
ments. Pearson did not answer, at least explicitly, the claim that the Tchoup- 
roff formulas are applicable to a more general ease in which there is no restriction 
as to the nature of the correlation between observations. 

The year 1928 was marked by two important contributions. We first mention 
that of G, C. Craig who published his thesis in Matron [22]. Extending the 
previous results of Thiele, he was able to write the gemi-inyariant oquivalont 
of the basic formulas in much less space than their previous moment formulation 
had demanded. He was able to write products of sample moments as well as 
moments of the moments themselves. His results are limited to an infinite 
population and one variable, The bibliography attached to his paper is com- 
monly mentioned in later literature for its completeness. For infinite sampling 
it might properly be used as a supplement to the bibliography of this Tarfc. 

A most important contribution was made by R. A. Fisher [23] who was able 
to simplify the infinite sampling formulas greatly. He did this by introducing 
the sample function whose expected value is a cumulant (semUnvariant). In 
addition to the simplification, his ingenious attack resulted in the following 
contributions ^ (iL).the recognition of the one to one correspondence between all 
possible independent sampling formulas and the partition of numbers, (2), that 
the extension of the multivariate form is accomplished by use of the partitions 
of multipartite numbers, (3) the tabulation of numerous new formulas, (4) 
the use of a general partition method by which any term in the formulas can be 
determined separately. 

The further development of the combinatorial analysis was indicated by a 
paper by Fisher and Wishart which appeared in 1931 [27}. It was shown how 
the more involved patterns could be broken up into simpler ones. 

The study of the infinite case was continued by Georgescu [28] who extended 
the Craig results, A feature of his work was the utilization of functions which 
yielded expansions of formulas in terms of successive degrees of approximation. 
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He applied Fisher’s idea of a combinatory analysis to the conventional sample 
moment function. 

Another paper of this series was that of Wishart [29] who gave a discriptive 
account of the contributions of Craig, Fisher, and Georgescu and an indication 
of the ineanB of expressing the results of one writer into the language of another, 

The work of Joseph Pepper which appeared in Biominba in 1929 [24] should 
be noted. Pepper took the case of the finite parent, sampling without replace- 
ment, and two variables, and then gave an extensive list of results. He did not 
have a very condensed notation and was forced to assume an infinite universe 
for the higher moments which he studied, The important point, for historical 
purposes, is that Pepper combined bivariate and finite sampling. It is to be 
recalled that Tchouproff himself in his generalised theory gave no results for the 
multivariate cose. 

A significant advance in finite sampling was indicated by the appearance of 
Cai'ver^s editorial on ^^Fundamentals of the Theory of Sampling/’ which ap- 
peared in the first volume of the Annals ol^ Mathematical Statistics [25]. 
Carver took the case of a finite universe, one variable, and sampling without 
replacements. He presented a notation which enabled him to write the various 
moments of the mean through the eighth in simple form. He showed by a 
number of illustrations that hia formula would give known results for eases 
both infinite and finite, when the proper restrictions were added. O’Toole [26] 
later generalized his results for any moment of the mean. 

3. Generalized Carver Functions and Sampling. The use of generalized 
Carver functions together with the results of Part I makes possible the presenta- 
tion of the general sampling theory in a compact, and yet not too symbolic, 
form. It is possible to write the sampling theory so that criteria 1^8 are satisfied 
although no attempt is made in the present paper to answer criterion 6. With 
reference to criteria 9-11, any affirmative answer must necessarily be tempered 
with qualifications as the results are far removed from that ideal solution which 
would permit one to determine the actual distribution of any sample moment, 
However the use of generalized Carver functions does permit a general concise 
statement of results as well as the determination of special oases. The method 
is also especially adapted to the introduction of new moment functions and to 
the use of partition analysis, although these topics are not emphasized in the 
present paper, In general it may be said that the use of Carver functions assists 
greatly in finding the theoretical sample statistics in the case of finite sampling 
since the Carver functions are condensed expressions of the size of the sample 
and the size of the parent, since they may be easily checked from symmetrical 
considerations, and since they are independent of the moments, They are also 
applicable to different replacement laws. 

4. The Use of High Moments. Precise agreement between theoretical and 
practical sampling does not usually accompany the use of high moments, and 
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fche practol statistimu is npt wilh I ViusiMt \vl») **{ havo a very 

firm coiwictioii that Jiinda^innlitiiuj who iih-.s UMiinciitH may mako 
intercstiiift coiiU‘il)uU<Hi.s to inatliHiiati»-.s tml In' Ijis work from any 

contact with actual statistics*' (IG; urj. I [owevor t ho nxtont of agrmnent 
bctwcctt tliooretiniil aiul actual iv.sulls is in a muiko a nwmnv (»f llm extent to 
which thcoroticul assum])tH’»is aro iv<‘Uml!y thn>lira(Vil in the vxpermwut, it 
Joes scorn sftusih hi to dLsenver what rchifituis nxisi in (In^ tlu^tavticftl case. 
Thiele impKeitly tlii‘orpti('al nsn of high ino]nr?il s (evrui in .studying 

ftcUmi probloms) when Iw wrote {IV; V\\\ 

'‘Tliorcforo fclie gt'oeral rule of the fonnal ion of good hissH of tuesumptive 

errors must ho 

1. In determining h , and Xa rely almost ojitiroly itijtai the actual values. 

2. As to tlie half-invariants with liigh indices, .sj»y ui)wanlsj rely as ex- 
clusively upon tlworntienl emmidvmtions. 

A more explicit advocate is 11. A. Fislmr ^vhn wrolc \%\ ; the present 

state of our knowlcclgo auy iuformatioib however imanuplete^ as to sampling 
distributions is likely to be of frequent use, ir^e^^peelivc of llie fact that moment 
functions only provide statistical csthmilc.s of high elUvieucy fov i\ fijuicial type of 
distributioii/’ 


Chapter H. Notation and Definition 

The present cliaptcr gives the fumhuncaital <iermiUons and appropriate 
notation. An attempt has been nuule u> combine the most de.siral)lo features 
of the different notations of earlier writers. 


6. Ordered Sample. An ordered samjde is u smnjde in \vhh*ii diHtiudiou is 
made as to the order in which tin' variate waiters the growing sainidc, Thus 
the sample found by drawing ai} and then Xi is tlie same sninple as that obtained 
by drawing Xi and then , but it is a different ordiued .samphu 
In some types of sampling it is po.ssil)l(i llial a gi\'en variate may appear more 
than once in the same sample. In gmnu’ul the number of ordered samples 
varies with the number of repeated variale.s. TUmh tln^ samiihi Xi + Xi results 
from but one ordered sample^ while Xi 4- .1-3 results from <?ithei* of Uvo ordered 
samples. 


6. Power Sums. Power sums have the siinm moaning as in section U 
Part I. Ail adjustment of iiotatiou is tiooessary as \vo need io diatinguisli power 
sums of the sample from power Hmn.s of Ilie nniveise. *)4u' n-th power sum of 
the universe is denoted by (4) while the saiiAple pt>wev sum is denoted by (a). 
Similarly, bold-faced numerals are u,s{'<l to indicate iJOW<>rHuinKof the universe, 
while light-faced numerals avv used to indicate ^mwer sums of the sample* The 
symbol (A) is used to indicate that the variates arc di^vhitions from tlic moan bl 
thcAmivme. 
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7. Power Product Sums. Power product .sums, called power products for 
brevity, also have the same meaning as in section 11 of Part I, Large letters 
are used to represent the power products of the universe while small letters are 
used to indicate the power products of the sample. Thus (QjQs * ” QO repre- 
sents a power product of the imiver.se while {qiq^ * • • {?*) represents the corre- 
sponding power product of the sample. Power products are not used exten-sively 
except in the development of the theory of the mxi chapter where they play an 
important r51e, 

8. Expected Values. If a given statistical function, z is formed for every 
possible sample, then tlie arithmetic mean of the sts is the expected value of z. 

N ^ fsl * 

Thus ^(2f) ~ where the £ holds for all possible samples and S is the nvimber 

of such samples. 


9. Moments, Moments demand precise Jiotation since distinction must bo 
made between moments of the universe, moments of the sample, moments of 
the moments of the sample, and moments about the mean for these eases. In 
addition we wish to indicate whether or not the universe is measured about its 
mean. 

a. Moments of the miverse^ Tlie conventional are used to indicate the 
moments of the universe. In this notation js used to indicate the moment 
about the mean of the universe, Thus 


Mi 


_ m . Si' 

N K 


and 


fit — 


< 1 ) = Zl 

N N ■ 


The usual formula relating and jit [22; 20] may be written 

so that 

0 -® 

, _ (3) _ 3(2) (1) , 2(1)' 

N N<‘ ^ ’ 

etc. 

It is to be noted that, when (1) = 0, /ai =: . 

b. ikfowenfa of the sample. We denote the moments of the sample by the 
letter n [23; 203], 

In much statistical work deviations from the mean of the universe are used in 
place of the variates themselves. When the universe moments about the mean 
appear, we indicate them with a bar. However in denoting the moments of the 
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eampIeB, the moments of the mem do not appear and some other device is 
needed to indicate whether or not the vaifates are measured about the mean of 
the universe. The simple notations mt and arc used to indicate that the 
variates used are deviations from the mean of the universe, A superprefix is 
used to indicate the case in which the variates are not measured about tlie 
mean^ . The values of fHi (and ’i^i) are obtained from the values of 

nh (and by means of the formula 

= £ ( *“ f )* * 1 2) 


c. Moments of the ■nia?nen^s of a Stacje there are luany possible 

samples and since a given moment can be computed for each sample, it is 
possible to express the expected value of this moment and the expected value of 
any power of it. The m’s are used for this purpose. Thus 




- sCm^y, 



If the first one of equations (3} represents the whole group, then the values 
}ir{Mt)t and iirCfhi) are mdicated by 

(r •!*) gi W- (4} . 

d. Moments of the produd of the moments of a sample. The term can be 

mdicated by B{icy) ^ liniXj y). Similarly the expected value of the product of 
rrta and nib may be indicated by E(mMb) == Mti(Wa , mt.). In general 




In the case of the product of sample moment functions^ when the universe is 
not measured about its mean, it is preferable to use a single superprefix, asso- 
ciated with the g instead of a number of thenv associated with each m function. 
Thus 

The usual laws for changing from moments to moments about the mean In the 
case of the multivariate distributions are available. Thus 
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m , W(,) ~ Aill(Wa t P^ioinla , W&)moi(Wp , W&). {6} 

mi(7na , 'mb , nic) = Aiiii(Wa , , two) - lAuoinia , Wfl)/iooi(Wfl , mb f me) 

— MJ0l(Wa , mb , Wo} iUoio(Wa j Wji , Wo) 

- Mou(mo , mb , Itlc) MlOo(^a J Wfc J Wo) 

+ 2jm(K)(ma , mi ^ me) mo{ma f wt , We) /^o(n(Wa ^ , Wo) (7 ) 

etc. 

10. Different Sampling Laws, For theoretical purposes, any Jaw may be used 
in the formation of samples as long as it results in functions of all possible samples 
which are symmetric functions of the variates. Any uniform law of replacement 
satisfies this condition and hence might be used in forming samples, Most 
statisticians who have worked on the sampling problem have been content to 
assume one or the other of two replacement laws. Each of these is ^^natural/’ 
since it has wide application in the study of actual sampling. 

The two types of sampling which have received general treatment are sampling 
from m infinite universe mtk any law of replacement and sampling from a finite 
umrerse with a law of no replacements. The results of the first type are also 
applicable to the case of sampling from a finite mwerse when replacements are 
made after each drawing. These two types of sampling have been characterized 
by the terms "sampling from an infinite universe,” or "sampling from an 
unlimited supply” [25; 1141 "sampling from a finite universe” [17], or 
"sampling from a limited supply” [25; 101], 

The theory of moments of moments for the first type of sampling has been 
developed to a high degree by sueh authors as Craig [22], Piaher [23], and 
Georgescu [28]. This extensive development has been due in part to the fact 
that the assumption of an infinite universe permits application of methods 
which are not applicable^ to the study of finite variation. The probability of 
getting a variate remains the same no matter what the law of replacement, 
The assumption of an infinite universe at first appears to make the results 
inapplicable to all actual problems where the universe is finite, However, if the 
universe is large, the assumption of infinite size does not greatly alter the results, 
although the extent of the change can not be determined without comparison 
with the results of finite sampling, A justification for the use of infinite sam- 
pling in actual finite sampling problems is based on the fact that the formulas 
resulting from sampling from a finite parent with replacements are the same as 
the infinite formulas. Hence the infinite results may be used to characterize 
finite sampling if sampling is done with replacement after each drawing. This 
clever scheme is somewhat invalidated, in actual sampling, because of the 
practicability of replacing and remixing after each drawing. Until someone 
demonstrates a technique which is practical and effective in' securing randomness, 
it must be said that the value of infinite sampling theory os applied to finite 
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sampling depmls upon the theoretically unsatiijfactory assumption that a 
finite universe is infinite. 

TJie theory of sampling from a finite universe without replacements 1ms been 
developed by such authors as Isserlis [8], Tchoiiproff [15], Neymau [18], Church 
[19], Pepper [%]: and Carver [ 26 ], although available results are not as extensive 
as those mentioned above because of the difficulty of algebraic manipulation 
and because of the length of the formulas. The fact is that tlie probability of 
getting a given variate varies with the different drawings. However, a "return 
to the bag" is not demanded. 

The terms “infinite sampling^’ and "finite sampling" are adequate to describe 
the two kinds of sampling discussed above, but they are inadequate in the case 
of finite sampling if additional replacement laws are introduced. Hence, it 
seems preferable to oharacteri^e the type of sampling by the replacement law 
if the population is finite. 

When the Carver functions represent known functions of n and iV, it is 
possible to use them in writing moment formulas for auy orderly replacement 
law. For example, it is shown in later sections how Carver functions can be 
applied to 

L Finite sampling without replacement, . 

2. Finite sampling with replacement rafter each drawing. 

3, Finite sampling without replacement up to the n-th drawing before which 

the ^ 1 withdrawn variates are replaced and mixed. 

The Carver function can be used symbolically even in cases in which its 
explicit statement in terms of n and has not been found. In some statistical 
formulas the Carver functions cancel, so that the results are independent of the 
sampling law, 

11. Variable Bistribution Laws. It is possible to generalise the theory to 
include the case in which the variable takes on a different frequency distribution 
after each drawing, i.e., the general Tchouproff formulas can be written in terms 
of Garver functions. This theory can also be generalised to include many 
variables. In this dissertation, however, it is assumed that the universe remains 
the same, aside from the unreplaced variates forming the sample, throughout 
the sampling process. 

Chapter HI. The Application of the Double Expansion Theorem 

It is the purpose of this chapter to establish the basic theorems on which the 
more specific work of the later chapters is based and to show how the double 
expansion theorem is to be applied to the sampling problem. 

12. Formulas Concerning Ordered Samples, a, 8a7npUng with replacemnts. 
If the samples of n ate taken from a universe of N variates and if the variates are 
replaced after each drawing, then the number of possible ordered samples is 
since for each of the n drawings there is a choice of N. 
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b, Sa/irvplinfj without r&placemenL If thu vavi^ite is not roplacod after each 
drawing, the number of ordered samples is 

1) ... 1) 

c. Boplacement before the Iasi drawing only. In case sampling is. with replace- 
ment before the last drawing only, the number of ordered samples is 

N[N ^n + 2)N ^ 


13. Theorem 1. All moments of moment functions of samples can be expressed 
in kms of expected mines of prodnois of power sums of samples. 

By moment functions we mean rational integral isobarie moment functions 
[31 ; 22], 

The theorem follows at once from the definitions of section 9. From (3 ) , j4}, 
(5!, {Sir (71 it is clear that all moments of moment functions of samples are 
expressible in terms of the expected values of sample moment functions. But 
since the sample moment functions are themselves defined in terms of power 
sums of the samples, the theorem follows. For example 




‘(A) ^ m) 

n n‘ 


*12 


hm 

L 


(i)(iy 




“14 


J 


( 8 } 


and 


iiiiinkf mi) = Mu(^ns, mi) “ juio(^j wi) 


^ E 

r(2)(i) _ (lyi 


r f( 2 ) _ (i)(i)\-i 

IS 




L V n ( 

— 1 

1 
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14* Theorem IL All moments of moment functions of samples can he expressed 
in terms of expected mines of power products of samples. 

This follows at once from the application of the multiplication theorem of 
Part I to the theorem of section 13. Each product of power sums is expanded 
by the multiplication theorem into sums of power productsr Thus 


M^mz) - E 




2(2)(i)(i) , av" 



15. Theorem IIL To emry power product form (qiqz • ■ * qg) Uiere corresponds 
a power prodwei/orm (QiQa • • * 

The argument is simple since the terms of {qiqz ■ • ■ ^a) are themselves terms of 
" Qa). It follows at once that, if {q^qz ‘ ^ Qs) exists, then (QiQz * * * Qa) 

exists. 
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As ttU illustraition, consider the universe consisting of , iiJa | , a;4 , ajs and the 

4 

sample consisting of Then the terms of (^i$2^a) "^ 2 

I 

are all nontained in the teiins of (OiQsQa) = S • 


16* Theorem IV. Ij definik fc’s can be dekmined so that 

“ ^PIP2 • • * PtiQ^Qz • * • 0 <); (ll j 


then it is possible io nse t?ie ofoubJe eajpansio/i i/ieorem and expi’sss the mwents of 
the moments of ike sample in kms of ikePfmeiions of Part I and the power su?ns 
(or moments) of ike universe. 

The double expansion theorem was designed to replace (qig^ * * - (?i) by 
*^j»iPr-P.(0iQ2 Q>y can be used as well to replace by 

‘ • * '^3) if the values of Jopipj.-Pi can be determined* The results 
of such a substitution in terms of the power sums of the universe are then given 
by the double expansion theorem, For example 

„ , *0(1)' B(2) , *0(11) 

and if 0(2) = fc(2) and 0(11) ^ kn(li) then 

^•.Cwi) = ih - hi) ^ ^ 

w n^ 


KndY 

«» ^ 

where K2 ^ h — hi ^nd ATn — hi ^ 

It then appears that the methods and tables of Chapter I of Part I can be 
used in finding expressions for moments of moments, in caseip,,,^,..^, is known. 
Thus 


PiC^fns) = M 


_ <iKL>T := - wm) . (i)(i)(i)(i) ' 

It ■ 71® ^ L n® n^ 


J 


^ P,(4) + Pu(2)(2) _ ^ p(4) + 2fti(3)(l) + fii(2)(2) + Pm(2)(l)(l) l 


w 


+ 




P4(4) + 4 Pi, (a)( 1 ) + 3 pM( 2 )(a) + 6P»u(2)(l)(l) + Piui(l)* 




and when (1) = 0 


M - (5 + ^‘) (5) + (5)®. 1131 
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where 


Pi = JC4 

“ 4^31 

— 3^28 

+ 

12^211 

— 

6Ajau 

Pai = 

hi 



3^211 


2/51111 

Pgj S!= 


hi 

— 

2^211 

+ 

. ^iiii 

Pzn = 




hn 

— 

hm 

Pm\ ^ 






fcnn 


as given by (54) of Part 1. 

The basic problem has thus been reduced to finding such that 

E(siqi • ••},) = hy..vXQiQi • ' • Q‘)‘ 


17. Theorem V. 


71 

The expected mine oj a mmph pow&t mm is always times 


the comsponding universe power sum no matter what the replacement law, 

The expected value of the sample power sum. is always the same even though 
the fc’s take on different values for different replacement laws. We note first 
that the number of ordered samples, /S, depends upon the replacement law. 
Now a given sample power sum, (a)^ has 7i terms, while the corresponding 
power sum of the universe, (.4), has N terms. All the a-th powers of the 
variates in the universe appear in the ordered samples and, if we add all possible 
ordered samples, these terms appear the same number of times. Hence 


(a) = k[{A) and 



Now the number of the a-th powers of the variate in 2 (^) is Sn so that each of 

Sn jr ^ (S/i 

the N variates appears times. It follows that £ hence 

that E{a) = ^(A). Hence 


£(a) — fci(A) where fci = ^ {16) 

no matter what the law of replacement. 

An illustration may serve to clarify ihe argument. Consider a universe 
composed of aji , ojg , and write the six ordered samples, Then 

S (^) _ a:” + xS + aij + aca -h tCa + a;? + era + Xa 4" + tsg + x l _ ^ 

(A) xl + xl + xl 

Eia) _ 2 _ n 

I 


and 
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18, Value of Ic^y-p, for sampling without replacement. Consider a universe 
and all possible ordered samples. Form (QiQi • • ■ Qi) and ^ (^ 1^2 ■ • ■ q,). 
Now 2(^192 •■•?,) is a symaieWo function of the vaviates and consists of 
products, and {Q 1 Q 2 ■■■ Qd consists of jV'*' products. Each of the 
iV'*’ products is repeated tlic .same number of time,s in the N products of 
E (<? 5?2 ■ ■ • ?«)■ To find the number of times such repetition i.s made, it is only 
necessary to divide the total number of terms in 2^ {qiQi • qt) by the number of 

terms in {QiQt Q,) whicli gives • Hence 

= 116) 
and, dividing by the number of ordered samples, 

E{q\(li ' * ■ ?a) ^ " ' Qit) (17) 

so that 

== p;5 

as stated in section 46 of Part 1. 

Since q*) ^ Silsa! * • - SplU(qiq% qi) 

and (QiQi • ■ * Q«) ^ Silsjl • ' > Sp\M(QiQi • ■ * 
it follows that 

( 19 } 

Most earlier writers on finite sampling have used the idea expressed in (19) 
as the foundation of their work. They have found it necessary to undertake 
enormous algebraic manipulation to expand in terms of monomial symmetric 
functions and then to expand back in terms of power sums after making the 
coefficient adjustment. Such long derivations are not only laborious, but they 
ate also apt to result in algebraic errors and the results obtained have not 
emphasized the symmetry which is inherent in tlie nature of the problem and 
which is very useful in checking calculations. It was Carver who first discovered 
the type of symmetric relation involved and who used it in obtaining a compact 
statement of the first eight moments of the sample sum in the case of a single 
variable. He, too, found it necessary to carry ov\t extensive algebraic manip- 
ulations as his reference to ^ lavish use of symmetric fuuctione*^ [25 j 104] 
reveals. His keen insight into the essential nature of this probli?m led him to 
the conclusion that such extensive algebraic manipulation should not be 
necessary and that it should be possible to apply P functions to sample moments 
of order higher than the first. His confidence that this could be done and his 
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encovivagemoat in the task have contributed in a large degree to whatever merit 
dissertation may have. 

With j it is at once possible to write the F function expansions* 

Following Carver^ we let Pi = ^7, P2 = h : » etc. and get, from sections 

iV 1^{]^ — 1)' 

43 and 44 of Part I, 

Pi = Pi 

P 2 = pj — p2 

P 3 ^ pi ^ 3p2 2p3 

Fa ~ pj — 7p!! “h 12p3 6p4 

etc. 


Pn = pa 

P21 = p2 — p3 

Pji " pi 3p3 “{- 2p4 

P22 “ P2 — ^Pa ■p P^ 
etc. 


10. Expected Values of Products of Sample Power Sums, Sampling Without 
Replacement* The tables of Chapter I of Part I are now available for use. 
Thus 

MsCmO = SCmi)' = i MiXf = ~ [A(3) + 3Pa(2)(l) + Piu(l)'l. {201 

Tl Tl 

where 

p _ n _ 3w(?i " 1) r 2n(n - l)(u “-2) 

' “ N N{N ~ 1) N{N 2) 

p _ n(n - 1) _ n(n - l)(n - 2) 

“ ivw^) ~1}(N~ 2) 

_ n(n- l')(n - 2) 
iV(iV- l)(Ar-2)‘ 

FoTinnla 120} might be written as 

wCmi) = ^[ftArM3 + 3ftiiV'M2/^i + PiuiVM] |21) 

n 

We note further that as iV 05 

NP3 n, Piii'/^ n{n - 1), PmAf^ nln - l)(n — 2) 

so that 

PaC^^i) - [Tipa + 3n(n - l)g2pi + n(n - l)(n “ 2)p?] {22} 

More generally 

Pm,. . •mf(Ql)(Q2) * ^ • (Qr) ^ Pmi**»Wr-^ MffiA*52 ’ ' ' ’ 


(23) 
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As N approaches infinity this becoirnis 

Pwi-.-Wp ( 00 (^ 2 ) (Qf') “ l^Qit^Qi ’ *’ * (24) 

The laws of infinite sampling may be obtained by replacing power sums by 
moments and by The tables given in a recent paper (31; 30-32] 

were obtained from the tables of P functions by this method. 


20. Sampling With Replacements. We next consider the case of finite 
sampling with replacements after each drawing. This is auch a simple case 
that the P's can be determined without finding the k's. 

Consider a universe and the possible ordered samples, Thus the nine 
ordered samples of 2 from a universe of 3 are indicated by the subscripts 


u 

21 

31 

12 

22 

32 

13 

23 

33 


The samples 11, 22, 33 are not repeated while the others are. The multiplication 
theorem can be used in grouping types of product terms as it was in Part I, 
but the terms themselves have different interpretation. Thus (1)(1) = (2) d- 
(11) can be written as (1)(1) - (2) + [11] where the (2) indicates the sum of the 
n terms found by multiplying an x by itself^ while the [11] indicates the sum of 
the n{n - 1) products formed by multiplying one x by another* Since some 
of the a;^s may be alike, it is possible to have squared terms in (I* 1], but they 
are not treated as squared terms, but rather os products. For example, if 
(1) ^ 


so that 


(i){l) ^ x\ + xl + T xiXi 


(2) **= and [11] Xixi T * 


In determining the expected value of (1){1), we note that 


S(i)a)- E(2) + i:u-ii 


where 2 holds for the jV" possible samples. Now ^ (2) = }c[ ( 2 ) and k'l = 

fl 

SO that .S(2) ^(2) as indicated in Theorem V. Also [11] is composed of 

products of X == f X a;/\ It follov^-s that 

i,i-l \(-l / \f-i / 


X [I’l] = 




N‘‘ 


and that 

( 2 ) 


n 

JV3 


= — (i)(i). 
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TV 

It appears that ^ plays the role of Pn . 

= ifi[(2) + [11]] 

^tA(2) + P«(l)(l)! 


The corresponding argument holds for the general case. Any product of power 
sums can be expanded in terms of (gi ?2 • • - gj), If duplicate variates are 
introduced, use the notation [g^gs • ■ ♦ gj. Form [qiQi • • ^ q$] for all the 
ordered samples. Now • ' * gj has 71 ^*^ terms and £ Igiga - * * gj = 
^(Qi)iQi) • • * (Qj) has terms, while (Qi)(Q 2 ) » • • (Qf) baS N* terms. 

It follows that h = — > Wiat 



T, [gigs ‘ • • gj =' 

(Q\)(Qi) * • ■ (QOj 


and that 

P[gig 2 • • • gd = 

= (QiXQd ■ ■ ■ (Q.). 

(251 

Hence 

Pmi 


m 

In general 

Pmy-mtiQiyiQi) • * ' 

(^a) “ ^ M 52 ’ ’ * * 

(271 


Comparison with ( 24 1 shows that the same basic laws appear no matter whether 
sampling is carried on with replacement, or, in the infinite case, without re- 
placement, 


21. Other Replacement Laws. The two cases just examined represent two 
extremes of orderly replacement laws. It has been shown in each case how the 
Carver functions can be used to express relations between the moments of the 
moraents of the sample and the moments of the universe. It is possible to show 
how these functions are applicable to other replacement laws. We take, as an 
illustration, the case in which no replacements are made after each of the first 
n — 1 drawings, but just before the last drawing the n — 1 variates are replaced 
and mixed. I do not present here the detailed argument, but simply indicate 
that the appropriate value of kp^..,p/is 

(0 _ , 

= ((n - 2)''> - + (2”' + 2'" + . . . + 2’")(n - 2)'*-*'} (28} 


n 

where Pa - and Pn - ^ . 
N 
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22. Different Frequency Laws. The distribution of variates may follow some 
known frequency law such as the nornialj rectangular, binomial, Poissou, etc. 
In such ft case, if the relations between the moments are known, it is possible 
to simplify the results. 

Chapter IV. The Moments of the Mean 

To illustrate the previous theory in a simple situation we consider the moments 
of the mean. Carver [25] has done this previously for the case of finite sampling 
without replacements, but he has taken the measures of the universe as devia- 
tions and has used the sample sum rather than the sample mean, O^Toole [26] 
has generalized Carveris work. 

23. The Moments of the Mean, Wo have at once 

fv si/ 

MaCwO = i Eilf = 1 [P.(2) + P«(l)(l)l 

71 

/.>('*»,) = = ^tPsO) + 3fti(2)(l) + Fiu(l)(l)(l)] 

PiCwi) « i E(,iy « i [P4(4) + 4P8 i( 3)(1) + 3p2i(2)(2) + 6Pii,(2)(l)(i) 

lit Tv 

+ i’anClV] 
and 



24. Moments About the Mean of the Sample Mean. Using {1), we get 

w(W«i[P8(2) + (Fu-PS)a)(l)I 

^ IJ°3(3) + 3(Psi - PsFi)(2)(l) + (Fill - 3P,iFi + 2Fj)(l)’] 

« ~ [F4(4) + 4(Fa - FaFi)(3)a) + 3F«(2)(2) 

+ 3(F,u - 2 FsiFi + F2F?)(2)(1)(1) 

+ (Fni, 4Fi„Fi + eFu/*? - 3Fj)(l)*] {30J 


etc. 
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These formulas can be written in the notation of moments of the universe as 
“ ~ [PsiVw + (Pu - p!)jvV?] 

wCm,) = ~[PsiVM3 + 3iP,i - PiPiWWi + (Pm - 3PnPi + 2P?)iVV?] jSl) 

ty 


etc, 


25. Moments of the Sample Mean When the Universe is Measured About its 
Mean. When (1) == 0, the formulas of section |23} become 

Mi(wi) - 0 

w(wi) = “ Pi(2) 

M \ P»(3) 

7r 

M i [Pi(4) + 3P„(2)*] 

lirimi) “ ^ Z] Pt\'...p’A?iy' • • • (K) ' 


and 


(32) 


where the 52 for all partitions having no unit parts. In the language of 
momentB {32] becomes 


X) ^ ^ ^ ^ *fei) ^ ‘ • (mpj) ' 

where the 52 holds for all partitions of r having no unit parts. 


(33) 


26. Moments About the Mean of the Sample When the Universe is Measured 
From its Mean, Similarly, when (1) = 0, the results of section |24) become 

Ai(mi) = iPj(2) = iWj 






him) == :7, Pa(3) = Z p^Njii 

w Tr 

M = ~ [P.(l) + 3 Pm(5)1 


1 


= ^ [P.JVw + 3P»JV*/I?] 


etc. 


1341 
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It is to be noticed that the values /Jr(wiO ai'e equal to the values Mr(wii). This 
results from (4) and the fact that ^ 1 (^ 1 ) 0. It should be noted also that 


27. Sampling Without Keplacetnents. The formulas in sections 23-26 are 
general formulas which become more specific as given replacement laws are 
introduced. If the law ia sampling without replacements, we recall that 

Pi = Pi > Pi Pi 5 = Pi 3p2 + 2p3 , etc. when ^ It is at once 

possible to write the appropriate formula. Thus 


ixiimt) = iizimi) = i Pz^ 

Tl 


, 3 


Q 4-9 lAf _ JofTi 

^2 Ipl 3p2 + 2p3JA^M3 2) 

Now /ia == 0 in any symmetric universe, for example a normal or rectangular 
one, so Aia(wi) = 0. 


n 

28. Sampling With Replacements, In this case ^ and we have 

pl(*Wl) - /41 


= i ln/f3 + n{n - 1)m1] 

n 


gsCmi) = i [nga + 3n(n - 4- n{n -* l)(n - 2)ix\] 

fv 

ItiOrfii) ~ i + 4n(« - 1 )ms(/i + 3n(n - l)ti5 

71 

+ 6n(n - l)(n - 2)piifi\ + »%][ 

and in general 

M ~ L (p.. p.,) 1361 

and 

^ i [ng2 - ngi] 

72* , 

fisCmi) a ^(nfis - StifisMi + 137) 

“ ti* + 3n(n ^ 1);^8 - en(n — 2)nifji\ + 3n(n — 2)ju{] 
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while 

- — 
n 

him) = ^ 

him) = = “^[^4 + 3(n - l)^ia] 

71^ 

etc. 


(381 


29. Sampling With Replacements Before the Last Drawing Only. The 
Yfilues of of section 21 determine the values of the P's. Thus Pj = 

1 V _ n{n — 1) 2(n - 1) , ^ n{n - 1) 2(n - 1) 

^ N NiN -!)■'■ N{N ~ 1) - iV(F=T) “ NKN - 1) 


wCnii) = 4 


n 


in - l)(^^ - 2) 


, (n - l)(nA^ “ 2) i\ . , 
“T ^ ^ 2 i3v| 




(n - l)(n - 2) 

N-\ 



(40} 


30. DiSerent Frequency Laws. As indicated in section 22, the frequency 
distributions of the parent may be characterized by some moment relationship. 
This relationship can be inserted and the resulting formula simplified. For 
example, if the law of the formation of the universe is that of the hypergeometric 
series [25; 113] 

h - pgir' + (41} 

we have 

P 

Mm) - jVp? 

Mmi) = ^Npgig^ - p’) ^ j^2| 

Tr 

etc. 

Where the values of P 2 , Pa , Pi are to be inserted according to the replacement 
law which is used in forming the samples. The results for sampling without 
replacement agree with those given by Pearson [1]. 


31. Moments of the Sample Sum. We might use the sum of the items in the 
sample instead of the sample mean. For example 
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The results would parallel tlie results above except that r!! in the denominator 
would be eliminated. It is the sample sum which is used in Carver^s article 
[25] and this should be noted in comparing results. 

Chapter V. The Mean and Variance of the Variance 

As a further illustration of the use of the Carver functions there are presented 
ill this chapter formulas for the mean of the variance and the variance of the 
variance. 


32. The Mean of the Variance. 


n iv ^ 


Pi (2) _ + Pi,(ir 


w 


1 


= i [(nPi - P,)(2) -- PuCiyi 


ft 


and 


= -4 (ftPi - Pi)Nlii. 

tr 


143} 


{44} 


When sampling is with replacements Pi =« P? * -r? and we got the well known 

N 


ih 

n 

while when sampling is without replacements, we have the well known 


{451 




1 ^ 


1 - 


1 

N 


146} 


33. The Se(J0ad Moment of the Variance, 

L n* 


becomes 


#43 
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and 

M + -) (4) + ft' ~ ft + ft*) (2)*, (481 

n^J \n^ n* n^/ 

Those of course can be written in terms of moments ot the variance. 

34. The Variance of the Variance, Since iU 2 (h« 2 ) == we 

have 

«<'™> - ( 5 -?+§)“>-* (5 


4" 


'Pn 


n\ 


2P21 I 


III 


3P; 


211 


\n 


FiPn , PiPn 


, 2 -] 




( 2 )( 2 ) 


« +£i^* (2)(l)(i) + 


Pnn 


pJ 


u 




(ly, (491 


71^ 71^ / 

Formula (49) may also be written as 

/izlhaa) == \ {n^p2 2nPi + PiWui — 4(nP2i — PaOiV^/isAt, 

+ (n'Pu -- 2?rP2t + ^Pn - n^Pl + 2-nPiP2 - Pl)N^}^l 

- 2(nPiu 3 P 2 U ^ 'Ji-PiPn + P&Pn)^V 2 Aii + {Pun Pii)-ZVVi)- (50) 

Formulas (49) and (50) are not expressed in torins of deviations of the variates. 
Neither do they assume any particular replacement law nor any particular 
type of universe. 

In case the universe is measured about its mean we can write at once^ by 
placing (1) = 0 in [49} 


Mm,) = ft " ft + ^) (4) 
\n^ w nv 


+ 




?1 

.n 


A' 




( 2 )( 2 ) (611 


and 


Milk) = i {(n'Fa - 2nPz + PONii, + {n'Pu - 2nP,, + 3Pm - n"P\ 

W 

+ 2nP^P^-Pl)Niil\. (52] 


35. Sampling Without Replacements, Using the P's as defined by sampling 
without replacements, it appears that the eoeflSoient of the in term 

fP, 2 P 3 , P,\ „ . N (N - n ) (n - l)(Wti - W - w - 1) . 

\n“ (// - 1)(N - 2)(]V - 3) ‘ ' 
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agrees with that given by Neyman [18; 477]j Tchouprofi [15; 660], Pepper 
[24; 234], Carver [26; 2701, Also the coefEcient of the fx® term 

^ ^ 4, ^ f ^ 

\n 

N{N - n)(n - l)(#n ^ 3JV' + 6iV ^ 3) ^ 
agrees with that of the above authors. 

As lar as the author is aware, m one has written the ceefEeients of p.^ , nsMi » 
and in the formula for U2(*?^2). 

The coefBoietit of is 

-min - 1)(N - n){Nn -N-n-l) 

The coefficient of fi^pi is 

Pin _ 3P2U _ PiPii . P2Pii \ ^3 
n* / 

_ 4iV' (n ~ 1)(N - n)[(2n - m - 3(n ^ 1)] . , 
while the coefficient of juJ is 

fPmi _ PnPn\ _ 2iV® {« - l){Ar - n)[{2n - 3)iV - 3{n - l)J , 
V«‘ n* ~ 2)(^ - 3) ’ 

It is possible with some algebraic manipulation to use the P functions to express 
the coefiicientis of the moments as functions 0! iV and n- The suggestion here 
is that such algebraic work is unnecessary since the left members of (53! • * • 
{67 j are as easily handled in an actual problem as the right hand members. 
It is possible to compute the coefficients from the p's and the P's without writing 
explicit expansions in torms of N and ti. Besides the formulas involving N 
and Ti are so lengthy that algebraic errors are apt to occur. The use of Carver 
functions is further advocated because the same basic formulas are applicable to 
all types of sampling and because the tables of Chapter I of Part \ are directly 
applicable, 





36, Sampling With Replacements. If *= the coefficient of 

is ^ [(n(w — 1)“*] =^= — while the coefficient of pi is 

7v fl** 

i [(n' ~2n + Z)nin - 1) - (n“ -2n + l)n“] = 

tI W 
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Then (52} becomes 

i “ l)*^i ~ (n- l)(n - 3}/j8j. (58} 

ft 

The formula for becomes 

== i ” 4(n — l)VaMi "* (w — l)(^^ — 3)/i2 

tv 

+ 4(2n - 3)(71 - -- 2(2n - 3}(n - , {591 

Now (68} can be written in terms of semi-inyariants by the use of /i4 X4 3X1 
and fii — Xa so 

^2(^2) “ ^ ^ 1)^X4 + 2n[n 1)X3]. 

71 

See IB'; 209], [22; 571. 

37 . Different Distribution Laws, Given frequency laws can be inserted. 
Thus (44) becomes 

= 4 (nFi - Pi)pq if the Aa 
tv 

while (52} becomes, if jZ* = pq and |Jj = pg(g’ -}• 
itiiifk) = ~ (n^Pi - 2nPi + Pi)pqiq^ + p*) 

tv 

+ ^ (n*Pn - 2iiP„ + 3 Pm -/P\ + 2nPjPi - PlW- (60} 

Other frequency laws can be inserted similarly. 

Chapter VL Tabular Presentation of Formulas, 

It is the purpose of this dissertation to show how the P functions can be used 
in finite sampling rather than to present an exhaustive list of formulas. The 
specific formulas of the two previous chapters are derived, primarily, for illustra- 
tive purposes. The implication is that other formulas may be derived similarly. 

However^ it is possible to present, implicitly in tabular form, a number of 
formulas. In this chapter there are presented formulas involving moments of 
weight equal to or less than 6. 

38. The formulas of weight 2. 
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can bc; wriUcD iu tabwlai* form, as 



CSl 

11 


2 

11 

2 

Pi 



1 

71 


11 

P2 

Pn 


1 



with little effort. The first entries in the top row indicate the power sums of 
the universe, while the columnar entries indicate the momenta of the sample* 
Now 



m ^ (Dor 

n 71^ 


and 



The coelficienta of the power sums in the expansion of m are entered in the right 

hand part of the table. Thus, under 2, there appear the entries - and ^ 

n 

These when multiplied by the power sums os indicated on the left, give ??i 2 == 

W-WO), 

71 til, 7ir 

Now the expected value is given by the proper P function expansion. The left 
hand portion of the table, which is the same as the P function table of Chapter I 

of Tart X, gives such expansions. ^Thus the coefficient of (2) in E{m^ is — — ^ i 


71 




■ P 


while the coefficient of (1 )(1) is — ^ Hence the complete formula is 


n 




as indicated above. 


39. The Formulas of Weight 3. Similarly the table 




21 

111 


3 

21 

111 

3 

Pi 




1 

n 



21 

Pi 

Pn 


■ 

. " • 

1 

1 


111 

p. 

3Pai 

Piu 


2 

^1 

1 : 
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can be used to give the formulas 


, 2P3' 

_ 0 ”1 __ r> 


(3)-3(§-^-5')(2X1) + 2^‘(1)’ {Q2| 


'.ufe, mO = (5 - 5) (3) + (§ ~ ®(1) - (1) 


MsCmO = 5 (3) + ^-5-* (2)(1) + a)\ 


TV 






163] 


164 ] 


In case we wish to express the results in terms of moments about the mean, 
(1) = 0, and we have 


fti(ms) = - 

\n n- 
ftiiiih, nil) = (3) 




^(mi) = ™ (3) 
rr 


so that 


,,(®3) = (^ - _a 

\n fir w ) 


MaCmi) = 


( 65 ! 

(681 

{ 67 ! 

{681 

{691 

170 ! 


The insertion of specific sampling laws gives the specific results of earlier authors. 


40. The Tabular Forms. It is further evident that the power of « in the 
denominator is equal to the sum of the subscripts of the Carver function above it. 
We might utilise this knowledge and write in the right hand part of the table 
the numerators of the entries in the tables above. The table of weight of 3 
would then appear as 



3 

21 

HI 


, 3 

21 

111 

3 

a 




1 


■ 

21 

ft 

fti 



^3 

1 


111 

ft 

3 P 21 

Pm 


2 

--1 

1 


and it is possible to read {62}, (631, {64}, (651, (661, and (67} directly from it. 
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The tables of weight If = 2^ 3, 4, 5, 6 are given in Table L The right hand 
partitions not involving unit parts are underscored as these indicate the columns 
which should be used if the universe is measured about its mean. As an illustra- 
tion we write from Table I the value of We get 



as previously indicated. 

The same tabular scheme can be used to write formulas of weight greater 
than 6. 

4L Moments of Other Sample Moment Functions. It is possible to use a 
similar tabular scheme when we wish to find the moments of other sample 
moment functions, We define 

= ® ( 1 )( 1 ) 

^ n ^ 

/ = M ^ 

’ w Jl® tt® 

? = w ^ ^(3)(1) _ 3(2) (2) ■ 12(2)(1)(1) _ 

* n n* 

and, in general, 


I 


In (— I)** (p — 1) t ^pii| 



(pi)'* < ■ • (p^r 


nf 


The formulas of weight 6 are given by Table II, 


(71} 


TABLE II 


Hjll 

5 

41 

a# 

311 

221 

2111 



-5 

41 

32 

311 

221 

2l« 

1“ 

iB 

B 

■■ 







1 

■ 






41 

Pi 

Pii 







-5 


I 





32 

P, 

Bl 

Pn 






--10 


1 





311 

P, 

2P^i 

Pn 

Pm 





20 

-4 

-1 

1 




221 

~Pi 

i’ll 

2Pai 


Pill 




30 

‘-a 

-3 


1 



2111 

P, 

3P.1 

Pjl 4" SPaa 

3Paii 

3P}ii 

P nil 



-60 

12 


-3 

-2 

1 


iim 

Pi 


IOPh 



lOPaiii 

Pam 


24 

-6 

-2 

2 

1 

-I 

i 
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Thxis toy example 

Wl.,l.) = (g-y‘ + 




n* 


n° 


+ 


IOF21 ^ 36P28 




n" 






a2 


N^iim- !72] 


If all the entries in the right hand part of Table I, except the unit terms in the 
main diagonal, are placed equal to 0, the tables can be used to give the moment 


function of the Ttia Thus, when = 3, 

Mi('wa) = §(3) 1731 

«0(3) + ^(2)(l) (741 

wCwi) = ^ (3) + (2)(1) + ^ (ly (75) 

and 

{76} 

n 

= (77) 

tv 

M = {78} 


42, Other Moment Functions. The tables give such formulas as Mr(7na)f 
/jfirsi^af m)f eto. If formulas for fir(^a), -^b) etc*, are needed, it is 

necessary to go through the usual work of changing from moments to moments 
about the mean* 

Let us derive a general formula for the correlation of the mean and the variance 
as an illustration of the use of the tabular formulas* By definition 


rni'ffktmO 


fin(mj mi) 





mu(w 2 , mi) = Mii(^ f mi) 

M2o(in2 , mi) = fls(lrlh) - Miimz) 

Pdiimz^ mi) - fi2(nii) - iil(?ni) ~ ^ia(7nl)* 


Now 
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Some of these values have appeared earlier in this paper, 
earlier results, we find from Table I 


Wl(^S> Wl) 



Without using the 



^ ) Njk + 


„ 2^1 . 3^^ 






w 




^ MS 






Pi 

utimi) = “JVffs. 
w 


Hence {79} becomes 
ni(??is, Wi) =5 


{nP2 - Pa)j5g 


[{n^Pl -- 2nFsP3 + ““ (n'PaPu - 2nP«P^i 

+ ZPA - n^P,Pl + 2nPlPi - Pl)Niilf 


1801 


FoTmula (SO] gives the comlation between the variance and the mean no 
matter what the law of replacement* If the universe is symmetric, jua « 0 and 
ru(in2 , mi) Q. 

The usual special cases may be obtained. When replacements are made, 
{80} becomes at once 




(a - 1 )m3 

- 1)^4M2 - (3 - 


{811 


as indicated by Pepper [24; 240]. 

When no replacements are made 180} reduces to results previously given by 
Neyman [Ig; 489] and Pepper [24; 245). 


43. Conclusion. The theory presented here is capable of generaliiation in 
many ways. For example, application to multivariate distributions readily 
follows* However an attempt has been made in this dissertation to emphasise 
the essence of the method. Illustrations have been chosen to indicate its 
inherent generality. 

It should be stated, finally, that the aim of this dissertation is not primarily 
to provide a list of sampling formulas, but rather to provide a method by which 
the desired sampling formula may be derived without too much algebraic work. 

In concluding this dissertation, I wish to acknowledge the guidance and 
encouragement of Professsor H. C. Carver. Also 1 wish to express my apprecia- 
tion to Professor E. A. Fisher and to Professor C, 0. Craig, who read the manU" 
script, or portions of it, and made needed suggestions for improvement, I am 
also indebted to Professor J. A. Nyswander and Profe.ssor T. H. Hildebtandt for 
valuable advice and assistance. 
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DISTRIBUTIONS OF SUMS OF SQUARES OP RANK DIFFERENCES 
FOR SMALL NUMBERS OF INDIVIDUALS' 

By E, G, Olds 


I. INTRODtrCTION 


In a recent article,'’ reporting the results of research under a grant-in-aid from 
the Carnegie Corporation of New York, Hotelling and Pabst have given a 
comprehensive treatment of the theory and application of rank correlation and 
have contributed significantly to existing knowledge on the subject, It is not 
the purpose of this note to evaluate their contribution but to attempt the 
solution of a problem they suggest. 

In §3® they have given the well-known formula for rank correlation, r' = 1 - 


fiSd 


n 


^ - n' 


• if 

where n is the number of individuals ranked and = S d? (d» being 

V»1 


the rank difference for the fth individual). In §6 the question of the significance 
of r' in small samples has been considered from the following point of view; if the 
value of obtained from a comparison of the ranks of n individuals as a possible 
measure of the relation between two attributes^ is such that there exists, a high 
probability that it could have occurred by virtue of a chance rearrangement of 
the n individuals, then the value of ?■' does not furnish a significant indication of 
relationship. Then one test of the significance of a particular value of r' is to 
note whether it has a probability less than P (P equal to .01 or, less stringently, 
equal to .06) of occurring because of a chance re-ranking. 

To apply this test it is necessary to have some information regarding the 
distribution of for the chance rearrangements of the numbers from 1 to n. 
Hotelling and Pabst have given the distribution of for the cases, n ^ 2, 3, 1 
They have noted that the distribution is symmetrical tor each value of n and 
that it has a range from to 1., From a consideration of the probabilities 
corresponding to - 0, 3, 4, 6, they have discussed the significance of values 
of for n = 5, 6, 7. In they have stated, ^'Another problem is to find con- 
venient and accurate approximations to the distribution of for moderate 
values of n, with close limits of error. A table calculated along the lines sug- 
gested in §6 would be very usefiiiP This statement, along with tlie interest 
manifested by others in private communications, has led to the investigation 
reported in this paper. 


1 Presented to the American Mathematical Society, December 29, 1936. 

® Harold Hotelling and Margaret Pabst, Kanfc Corretatioiv and Teais c/ Stpm/tcance 
Imolnn^ No Assum'piion of Nomalilyf Annals of Mathematical Statistics, Vol. VII, 
1936, pp. 29-43, 

* Loc. cit. 
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II, EXACT DISTRIBUTION OP SUMS OF SQUARED DIFFERENCES 

In the paper mentioned above, the authovs have given the e%act probabilities 
for all possible values of / for n = 2, 3, and 4. Since r' is a linear function of 
2(f for any particular value of n, there is a one-to-one correspondence between 
values of Srf and values of r^ For example, for the case of n = 3, we have the 
following: 

= 0 2 6 8 



-i i i i 

^ “ 31 31 3! 31 

where f represents the relative Jrequeney of r' or of Therefore it seems 
pertinent to investigate the distribution of for various values of w. 

If n individuals are ranked 1, 2, 3, • • • n, by one criterion and then are re- 
ranked at random there are n 1 possibilities for the new ranking. Let us consider 
the differences between the numbers in the new and in the original rankings. 
Suppose these differences are represented by rfi , <i 2 , • ♦ » rfn. Then it is apparent 

n 

that S df = 0. If we let fli , 02 , • • • o* represent an arrangement for n ^ k 

insert fc + 1 ^^fter ajt and advance the cycle one position at a time, we have the 
following arrangements for the case, n = ?c + 1 : 


ah , fc + 1 

4™ Ij a\ 


ak ) ^ 4" Ij ai f • - ■ , o^-j 

fc 4 ” ai , 02 , ■ • • , Ojfc 

Now, for w = ifc, di = Oi — 1, dg = 02 — 2, . » . — ojtj — fc. If we list the 

differences for the fc + 1 derived arrangements, we have 

di r ds. j t?3 ) ' ' ' dk j H 

da + I > da 4" ^4 4* 1) ‘ • I , di — fc 

da + 2 , 4" 2, ds 4- 2, * * 2, di 4- 1 fc, d2 4* 1 — 


d/if 4“ — Ij fc ™ 1 , di — 2, 

j di - 1, d2 - 1, 


dh-1 
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It is apparent that each row of differences is formed as follows; the entry in the 
first cohimn is formed by adding 1 to the entry in column two in the row above, 
the entry in the second column is obtained by adding I to the entry in the third 
column in the row above, and so on until we come to the entry in the last column 
which is obtained by subtracting k from the entry in the first column of the 
preceding row. 

If we form the sum of squares of the entries in each row we observe an interest- 
ing property of the set; the sums are all congruent, modulus (ft + 1). Let us 
write the sums, denoting them by /Si , * &+! . Also let represent the 

entry in the iih row and jth column. Then 

s* = 2 di 

jmml I 

/Sf+1 = ^ 2 {di,i + 1)^ + (d,M -ft)*^ 

j'—l /•‘2 

= Z) (dij + 1)^ + (df.i — kY + 1)^ (3) 

}“i ^ ' 

A+I 

= 2 Wl/ + 2c/,,,- + 1) - (2«/c.i ~h + l)(ft + 1) 

= ;Si “b 0 4* (ft + 1) (2df,i — ft + l)(ft + 1) 

Noticing that di,i ^ -f ^ - 1, for i = 1, 2, * . . ft, and dft+i.i = ft, we have 


S, ^ Si + (ft ^ 2di)(fc +1) 

Sa = S 2 + (ft ^ 2^3 - 2)(ft + 1) 

S 4 = Sa + (ft - 2^3 - 4)(ft + 1) 

: (4) 


Shi = S, + (ft ~ 2d, 2ft 4 2)(ft +1) 

Sh3 - iShi + (ft - 2ft)(ft + 1) =. Shi ^ ft(ft 4 1) 

Of course, S^s « Si , as the (ft 4 2)nd row is identical with the first and the set is 
closed. So we may write. 

Sjt+i = + ft(ft + 1) (6) 

The analysis given above not only establishes the congruence of the sums, 
modulus (ft 4 1), but also indicates a method of deriving the sums forn ~ ft + 1 

k 

from the sums for n = ft, since Si « Z) d? . It is also worth noticing that S,>i 

i»i 

depends not only on S< (and therefore on Si) but also on (and therefore 
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Another matter Jieecls attention. It is the relation between the sums of 
squares of deviations for a particular order and for the reverse order. Let 
cji , . an be a particular arrangement. Then the reverse order is a,^ , 

an-i j • ' ^ m . The sums of the squares of the deviates are, respectively, 


S ^ {di ^ 1)^ d" (^2 ~ 2)^ + ’ ' ‘ (a* ^ 

S ^ (ajt — 1)^ + 2)^ + • • ‘ (fti — Jcf 


(6) 


and 
Then 

5 *T jS =s= [(ai — 1)^ ”1“ (^i ” H" [fe ^ 2)^ d" ((^2 ^ A l) ] 

+ • “ [(ajb — + (ua 1)1 

« 2 l(0r - >r + (a, - fc + r - 1)*] 


A *• 

== Ti {(flr - r) + (Cr ~ + r - l)f - 2 2^ («, - r)(fl, - fc + r - 1) 

r>^] 




4ia5-4(fc+l) t «, + (*: + l)t 1-2 £«” 

r“l r™l r=l r*"! 


+ 2(i4- 1) io, - 2(^:+ 1) Lr + 2 t r^ 

r”l 


)-rti 


k 

I 


Noting that SoJ =: Sr* and 20, = Sr, we readily obtain the result* 

k*~k 


6 + S = 


k'-k 


(7) 


k’-k 


It is now apparent that the sums range from 0 to ''^^Ih a mean of 

d 0 

As the exact frequencies for sums of squares do not seem to be available, it 

seems useful to compute them for certain small values of n and, at the same time 

*The geometric representation of the problem may be of some intoreat. Let the co- 
,ordinatc» of point fZ, in Euclidean n-space be (1, 2j 3, ^ ^ n), the coordinates of ti bo (n, 
n — \j > * > 2, 1), and the coordinates of P be (asi, asij ** • a^n). LetuB rcBtrict the $'8 to be the 
numbers (1, 2, 3, . • • n), but not necessarily in the order given, i.c- the locus of P is a set of 
n| points, corresponding to the permutations of the numbers 1, 2, 3, . ♦ • n. Then it is easy 

to see that ^ ^ ^bat points P Ue on an n-flat or hyporplane. Also « 

2 fii 

n(n 4* 1) I2n 4^ 1) , 

— so points P lie on a hypersphere with center at the origin. Let us consider 

the joins PR and PR, It is readily eetablishod that they Jire orthogonal. Then (PiZ)* + 
(p^)2 « {RRy = or, since ^ ^ (a;; - i)^ and S ^ (ar/ - n i - 1)\ S ^ 


ir - n 


» result previously established otherwiso. 
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to devise a method which can be used successfully to extend the computation to 
larger values of n if desired. The details of the method follow. 

Let Dn represent any series of n differences, dn ^ , and let 0 ^ be an 

operator such tliat 0 „ operating on (written On{Dn)) means that Dn = 
id},d2, • ■ • rfn)iis changed to (rfa + 1 , (ia + 1 ^ + l,di- {?i - 1)). Let w, 

written following , ds , • • ■ dn , indicate that 2d* = m. For n ^ ^ 

Au = (0, 0, 0):0 

== = (1, L 

0 s(D,^ 2 ) - A .3 = (2, ^1, ~1);6 

— jfc 

But we have shown that 8 + B = — 5 — for n = fc. Therefore, for n = 3 , we 

a 

have iS + S 5= 8, BO sums of 0 and 6 indicate corresponding sums of 8 and 2 
wheii tlie order of the elements' is reversed. Thus we have, for n = 3 . 


Sums 

0 

2 

4 

6 

8 

Frequencies 

1 

2 

0 

2 

1 


For n = 4 we have 

= ( 0 , 0 , 0 , 0 ) 

A.3,1 - (2, -1, 0) 

where these are obtained from A.i > LI3.2 and A, 3 respectively by inserting a 
zero as a fourth difference. We operate bn each of these four times with 0 ^ . 
For example, 



5=; 

(1. 

1, 

-2, 

0): 6 

04(1)4^2,1) 

— D4,2,2 - 

= (2, ■ 

-1. 

1, 

-2): 10 

04(£)4,2,2) 

= £)4,2,3 " 

= (0, 

2, 

~1, . 

-1): 6 

04(i)4.^.3) 

- Di,u - 

= (3, 

0, 

0, • 

-3):18 

04(1)4,2,0 

=s= <1)4 ,2,1 - 

= (1, 

1, ' 

2, 

0) 


As a check on computation, we notice, first, that the set ia closed by the re- 
appearance of D4,2 .i ; and, second, that 10, 6, 18 and 6 are congruent, modulus 4 . 
In like fashion, one of the sets for n = 5 , is the following ; 

A. 2 .ui-( 3 , 0 , 0 ,^ 3 , 0);18 

A.2.4.2 - (1, 1, -2, 1, ^1); 8 

£^5, 2.4, a ^ (2, 2, 0, 


’I 
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I>W,M = (0. 3. 1 . - 2 , ^2);18 

2, -1. -I, -4):38 

Dwa « (3, 0 , 0 , ~3, 0 ) 

Of course the sums for b can be obtained from those for n = 4 by making 
use of (4)^ For — (3^ 0, 0, '-3) w& have = 18, 4, di = 3, <^2 0, 

di 0,'d4 ^ -"3- Then 


Si =2 18 

S, = + (4 ^ 2.3)(6) ^8 

- & + {4 ^ 2*0 ^ 2)(5) - 18 
^4 = 1 S 3 + (4 2^0 ^ 4)(&) ^ 18 


- S4 + {4 ^ 2.^ 3 ^ 6)(5) - 33 
Si = 4.5 = 18. 


However, results obtained by this latter method do not help with the case of 
rt = 6 . If TVe desire to obtain results for = 6 we will need to exhibit the 
complete sets of differences for = 5 as we did by the former method. 

An alternative method for obtaining frequencies of sums of squares is of some 
interest, It will be illustrated for n ^ L Let us consider the square array 



If we form all possible products ar5,’&jbd;(i, i, I - 1, 2, 3, 4; i j 1 ?^ fc 5 ^ i), 
the subscripts give the 41 permutations of 1 , % 3, 4. Now let us form a new array 


/cfo bi Cj (ij 

ff-i bo Cl d% 

ct^2 6-1 Co di 

\a^ c^i do, 


where subscripts in each column represent the vertical distance of the term 
above the principal diagojial Since the original terms had subscripts giving all 
possible arrangements of 1, 2, 3, 4, terms formed in a similar fashion from the 
new array will give all possible arrangements of the differences. Now form a 
third array 

a;“ a?* a;^\ 


where the exponent of x is the square of the corresponding subscript in the 
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TABLE I 


Frequencm of sums of squares of rank differences 



3 

3 

1 ■ . . 

1 

1 

5 

6 

7 

0 

1 

1 

1 

1 

1 

1 


t 






2 

1 1 

2 

3 

4 

s 

6 

4 


♦0 

1 

3 

! 6 

1 10 

6 


2 

4 

6 

1 9 

14 

8 


1 

2 

7 

1 16 

29 . 

10 



*2 

6 

1 

26 

12 


2 ’ 

1 

4 

|. 14 

. 35 

U 


'4 1 

10 

1 24 

46 

16 


1 1 

6 

20 

55 

18 


3 i 

10 

21 

54 

20 


1 , 

*6 

! 23 

74 

22 



10 

28 

70 

24 


, 

6 

24 

84 

26 




34 

90 

28 



4 

20 

78 

30 



6 

32 

90 

32 



7 

42 

129 

34 



. 6 

29 

106 





)k 


36 



3 

29 


38 



4' 

42 i 


40 



1- 

32 i 


42 



1 

20 

98 

44 




34 , 

168 

46 



. ■ i 

24 

130 

48 




28 

175 

SO 




23 

144 

B2 




21 

168 

54 




20 


66 




24 



♦The asterisk shows the looation of the mean. The frequencies forn 6, 7 extend be** 
yond the Umita of the table but may easily be obtained by symmetry. 
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second array, It is easy to see that, if terms are formed from the new array 
by the same method as before, oyu* toms ave powers of x where the ex-pouents 
represent vsums of squares of differences. If we now define the array to be equal 
to the sum of the terms formed from the array, then 



X 


X 

X 

X 


1 

Q 

1 



=!= hix^ 4 ' 4 " 4 " 


M 




and the fc’s give the desired frequencies for sums of squares corresponding to 
exponents of x. For example 2d* == 0 occurs ki times, 2d^ = 2 occurs times, 
etc. 

It can be readily verified that, for ^ < 5, the array can be expanded as a 
determinant and tlie values of the fc's can be obtained by taking the absolute 
values of the coefficients in the expansion, Also, considering the arrays as 
determinants^ their values for n ^ 2, 3, 4 are, respectively, (1 — (1 — rcY 

(1 — a;^), (1 a;^)® (1 — (1 ~ If it were possible to obtain a general 

form of tins type it might be possible to greatly reduce the labor which is in- 
volved in expanding the arrays. At present, however, this method of attack 
does not seem feasible on account of the lack of adequate sub-checks, the amount 
of work involved, and its iiiappropriateuess for use by iuexperieticed clerical help. 

Hotelling and Pabst^ have given exact results in terms of n for the cases 
= 0, 2, 4, 6, It is certainly possible to follow their method to obtain general 
results for 2d^ larger than 6, but, as they suggest, the work becomes very labo- 
rious. For 2d* = 8 we need the sets of possible integral values for xi^xz^ ' • * , 


under the following conditions: (a) 






0,(b)ta:^ 




8, (c) 1. + afi , 2 + * 2 , 


3 + > 

4 4- a;4 , ■ 

• • n + a;„ 

are the numbers I> 2, 3, • • * w 

, (but not necessarily 

in that order), 








Possible 

solutions 

are; 







(a) Xf-s 

- 2, = 

= 0, = 

— 2 (i 3, 4, ' ‘ • n) and the other x’a ‘ 

zero. 




(b) Xb_4 

= 2, jCb-i = 

= - 1, n ' 

^ ^ I, ™ 1, Xfi ■»>* I ■ 

= 5, 6, 

• ^ • n; 

h 



. 4,. 

■ • a - 2), 








(c) Xb-i 

^ ljXb=^ 

1 , X(]~-2 - 

^ 2j =! — *1, 

6, 6, . . 

• n; & 


2, 

3, 

» * 1 

ft - 3), 








(d) xm 

= -2, Xb. 

-1 1 , ^^4 

= 1, Xfl— 1 1, Xa —1 (d s= 

5, 6, . . 

• n;h 


3, 

4, 

'h f m 

a -2), 








(e) Xb_i 

^ 1, art = 

1) 

^ ““2, Ij Xa ^ 1 ^ 

5, 6,. . . 

- n; 6 


2, 

3, 


' t ■ ft — 3)j 


iCd — 1 ^ m, — I — Xf ) — “ Ij ^ Sfff “ ™ pCo ^ — 1 (ft — 8| ^ 

b = 6,7, ••■a-2;c = 4,5, .■.li--2;rf = 2,3, c-2) 

Frequencies for each of these types must be considered separately. The 


* Loo. oit. p. 36. 
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method of evaluation will be illustrated for type (f), since this type yields the 
nolvnomial of highest degree. It is apparent that the required frequency is 

obtained by computing S ( S ( S (2 1 ) ) )■ It can be verified that the re- 
sult is 

(w - _ (n - 4:)(n - 5)(n - b)(?i - 7) 

4! 24 

The total of (a), (b), (c), (d), (e), and (f) is 

(n - 2) -b 2(n - 3)'=' -f 
For 10, the result seems to be 

I 

2(» - 3) + (n - 3)® -b (tt ~ 4)*'* + 

For sums greater than 8 the method becomes quite uninviting, not only 
because of the intricacy of the necessary analysis, but also because of the 
opportunities for mechanical errors and the absence of satisfactory checks. 
Besides, if the exact distribution for a particular value of is desired, we need 

expressions for = 0, 2, 4, • - • ™ 2. For n as small as 8, this means 

the requirement of 42 formulas. It is fairly evident that these formulas will 
comprise polynomials ranging in degree from 0 to 41, 

nU AnPHOXIMA-TIONS 

Since the exact distributions of sums of squares are not easily obtained, we 

next consider the problem of finding approximations for them. Hotelling and 

Pabst^ have given a method of deriving the even moments of the distribution of 

(the odd moments being zero), and have recorded the values of the second and 

fourth moments. They have also remarked that the kurtosis, 

approaches 3 and that the distribution of r' approaches normality as n ap- 

proaebes infinity. These are valuable and interesting results. Because oS 

them the normal curve suggests itself as an approximating function. Its use 

has been considered a little later in this investigate. 

But a distribution with a finite range causes trouble at the tails when a normal 

fit is attempted, and, for this problem, we are particularly interested in the tails. 

It seems more feasible to attempt an approximation with the Pearson type II • 

/ ^ 

curve, y 2 /o( 1 ^ 

\ a 




m 


This has the advantage of a finite range and three 


‘‘Loc.cit.p.S^et &eq. 
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constants to be determined. The values of these constantsj as given by Elder- 
ton^ are 

Sft --9 j _ 2jus^s, 

(where N is the total frequency). 

If we use this distribution to approximate the distribution of sums of squares^ 
it proves convenient to define % as equal to oue-half the deviation of from its 
mean, i.e., 

2 12 


N X r(2w+2) 

0 X 2”"''' X [r (m + Df 






Tlien the relative frequency of Xcf = is approximated by 

J ^ fix) dx ^ fM where = 2 

(Of course, closer approximations may be obtained j if desired). The approxi- 
mation used is clear if we remember that only even values of k are possible and 

?i^ — n 

that the range is now — r — . 

0 

The moments for x are now obtained from the moments for / by multiplying 

ti 

by the proper powers of ■ . We have 


!= (n - 1) 


n(n + 1)T 


6 


The value of is unchanged. For / or a; it is 

I 

. 3(25?!.* - 13?i’ -- + 37?t + 72) 

^ ™ 257i(n -f l)^(n — 1) 


For n “ 5j ^jij 25> /3i “ 2.0720, JV = 51. Using these values and equations 
(8), we obtain a = 10.566, m - .73276, = 7.S545. The approximating 

function is i; 7,8545( 1 - computed values of y 


and the true frequencies are listed for comparison. 

When testing the significance of a particular value of our principal interest 
is ill the probability that Xct < rather than in the probability that Z(f ^ k. 
The probability that £d^< fe requires cumulation of frequencies, followed by 
division by the total frequency. If results, given in table II, are compared it is 
noticed that the maximum error in using the type II function is .0194 and the 
average error is .0072. Gompavisous for other values of n are given in table III. 


^EldcHOTij W, P., Frequency Curves and Correlaliorit Layton, London, 2nd ed., 1927, 
p, 84. 



TABLE II 


Com'parison of exact and approximate freguencies for n = S 

^Approximations obtained by computing ordinates of 

/ \ .nm\ 

^ " irfrd ) 


2d’ 

Frequencies 

CuTnuUtWe (expressed 
ns percent of 120) 

Difference of cumulatives 

Exact 

■ Approxi- 
mate 

Exact 

Approxi- 

mate 

0 

1 


.0083 

.0125 

-.0042 

2 

4 


.0417 

.0378 

+ .0039 

4 

3 

4.21 

.0667 

.0729 

-.0062 

6 

6 

6.14 

.1167 

.1157 

+ .0010 

8 

7 

1 5.91 

.1750 

.1650 

+ .0100 

10 

6 

1 6,52 

,2250 

.2193 

+ .0067 

12 

4 

1 7.01 

.2583 

.2777 

-.0194 

14 . 


7.39 

.3417 

,3393 

+ .0024 

16 

6 

! 7.66 

.3917 

.4031 

-.0114 

18 


7.80 

.4750 

.4681 

+ .0069 

. 20 

6 

7.85 

.5250 

.5335 . 

-.0085 

average of abso- 
lute values = .0072 


TABLE III 


Approximating functions f with errors involved 


n 

5 

Approximating functions 

Average and maximum absolute values 
of differences of cumulatives 

Typo n 

Normal 

! 

Exact — 
type 11 

! Exact- 
normal 

Type li- 
no rmal 

/ ^2 \. 73276 

51 

'V/50t 

.0072 .0194 

1 ,0200 .0415 

1 

1.0210 ,0357 

6 

/ „2 \i.aU6 

S1.662 1 1 — 1 

V 351,767 

61 

e m.5 

.0030 .0126 

.0131 ,0273 

.0130 .0270 

7 

8 

9 

/ ^2 \'2.0l6fl 

166,33 1 -- r;^' ) 

V 918.84/ 

71 -- Ei_ 

— -p 2ftL33 

•\/261.33t 

.0017 .0067 

.0106 .0221 

.0108 .0209 

/ \2.e83B 

81 

— 7 — - e ^^4 

\/60S 



.0086 .0175 

/ Jl \ 3.3140 

6276,3 1 1 

V 4332.6/ 

91 

A BdO 

V QOOfl" 




JO 1 


101 

1612, S 

■\/l612.6r 



1 
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It would be veiy collve^^^etlt if the cumalative frequencies could be appvoxi- 
mted by the use of normal curves. In table III ate listed the proper normal 
curves, along with comparisons with the exact values and with the values 
obtained from the type II curves. For the values of n investigated the normal 
cum is not as satisfactory as the type II. This, of course, is to he expected 
because of the lack of agreement between the fourth moment of the normal curve 
and of the exact distribution. However, in view of the fact that, for values of n 
investigated, the maximum and average errors decrease as n increases, it seems 
satisfactory to sacrifice accuracy to expedience and use the normal curve as an 
approximating function for cases of n greater than 10. This has been done in 
constructing table V. In further justification it might, be noted that , which 
approaches 3 as n approaches infinity is an increasing function of n for n greater 
than 3. 


IV. TAULES to test the significance op TKE llANX COHBELATIGN COEPPICISNT, 

WITH EXAMPLES OF THEIR USE 


Table IV gives the probability that, for any given value of n and a computed 
value of less than or equal to the mean, the value will not be exceeded by 
chance. For a value of S/ greater than or equal to the mean, it gives the 
probability that the value will be equalled or exceeded. The values for n = 
2, 3, if 5, 6, 7 are computed from exact frequencies; those for « 8, 9, 10 am 
computed from type H curves. 

Table V is constructed by the use of normal curves. It gives the limits of 
for a few of the more useful probabilities. 

It seems desirable to explain why values of were tabled rathor than values 
of r'. It was done for two reasons: first, to avoid the difficulties arising from 
discrete variates; and, second, because the tables seem more useful in the form 
given $ince the labor of completing the calculation of can ho avoided if the 
computed value of tests as not significant. 

Example 1, Seven individuals are ranked by two criteria, as indicated below. 
Are the results significantly alike? 


A 1 2 3 4 6 

B 2 1 6 3 4 

d 1 3 -^1 

dM 1 9 1 1 


6 7 

7 5 

1 -2 / 0 

1 4/18 


Solution; EowsB and 4 give the differences and squared differences, respectively. 
If we enter table IV with n - 7 and = 18, we find P ?=* .0648, so we would 
expect that a value as small as 18 would occur by chance more than 5% of the 
time, This does not usually indicate significance so it is useless to compute the 
value of r'. It is interesting to notice that r' actually does piv 

,68 and that, if we had used the formula, - L0471 ( i-TJ! 

\ yn 


ve to be equal to 
^ we might have 
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TABLE IV 

The ^roboMlUy that > S fov ;S > £ m; or that < jS for jS < S (^l}/lere S 

wean of sum of squares) 


1 

V -2 

3 

4 

5 

6 

7 

s 

0 

1 10 

hi 

1 

4 

10 

20 

35 

66 

84 

120 

166 

S ' 










0 

.5000 

wM 

.0417 

,0083 

.0014 

.0002 

*0003 


.0000 

2 

,5000 


.1667 

.0417 

.0083 

.0014 

.0006 


.0001 

4 


1^^ 

.2083 

.0667 

.0167 

.0034 

.0011 

jjj^y 

.0001 

6 



.3750 

.1167 

! .0292 

.0062 

.0018 

.0005 

.0001 

8 


,1667 

.4583 

.1750 

.0614 

.0119 

.0028 

.0007 

.0002 

10 



.6417 

.2250 

.0681 

.0171 

. i 

.0042 

.0010 

.0003 

12 



,4683 

' .2683 

,0875 

.0240 , 

.0069 

.0015 

.0004 

14 



.3750 

.3417 

,1208 

,0331 ' 

.0081 

.0020 

.0005 

16 


1 

,2083 

.3917 

. I 486 

.0440 i 

.0108 

.0027 

,0007 

18 


1 

.1667 

.4750 

.1778 

.0548 , 

,0141 

.0035 

,0009 

20 



.0417 

.5250 1 

.2097 

.0694 

.0179 

.0046 

.0011 

22 




.4750 

.2486 

.0833 

.0224 

.0057 

.0014 

24 




.3917 

.2819 

.1000 

.0276 

.0071 

.0018 

26 




.3417 

.3292 i 

.1179 

.0331 

.0087 

.0022 

28 




.2583 

.3669 

.1333 1 

.0396 

.0106 

.0027 

30 




.2250 1 

.4014 

. 1512 . 

.0469 

.0127 

.0032 

32 




.1750 

,4597 

. 1768 ' 

.0650 

,0152 

*0039 

34 




.1167 ' 

.5000 

,1978 

.0639 

,0179 

.0046 

36 




.0667 

.5000 

.2222 

.0736 

,0210 

,0054 

38 




.0417 

.4597 

.2488 

.0841 

.0244 

.0064 

40 




.0083 

.4014 

.2780 

.0956 

.0281 

.0076 

42 





.3569 

.2974 


.0323 

.0086 

44 





,3292 

.3308 

1^9 

.0368 1 

.0100 

46 





.2819 

.3565 

. 1345 

.0417 1 

.0114 

48 





.2486 

.3913 

■lyi 

.0470 1 


50 





.2097 

.4198 

bB 

.0528 

■qIb 

52 





.1778 

.4532 

*1806 

.0589 i 


54 





.1486 

.4817 

.1974 

.0656 ! 

.0189 

56 





,1208 

.5183 

.2150 

.0726 , 

. 0212 , 

58 





,0875 

.4817 

.2332 

.0802 

.0237 
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TABLE lY—ConGhided 


AT 

8 

9 

10 

iv 

8 

9 

10 


84 

120 

165 

% 

84 1 

120 

105 

s 




i 



126 

,1078 

.4568 

.2580 




.4865 

12a 

.0058 

.4397 

.2694 



,1351 

.4731 

. 130 

.0841 

.4226 

.2810 

172 


.1248 

,4596 

132 

.0736 


.2928 

174 


.1149 

.4462 

134 

, .0639 

,3888 

.3048 

176 


.1056 

.4328 

136 

.0550 

.3721 

.3169 

178 


.0966 

.4196 

138 

,0469 

.3557 

.3293 



,0882 

.4063 

140 

1 .0396 

.3394 

. .3418 



.0802 

.3931 

142 

.0331 

,3234 

! .3545 

184 


.0726 

1 .3802 

144 

.0275 

.3077 

! .3673 

. 186 


.0656 

.3673 

146 

.0224 

,2922 

1 .3802 

188 


.0589 

.3645 

148 

.0179 

.2770 

.3932 

190 


.0528 

.3418 

150 

.0141 

.2622 

.4063 

200 



1 .3293 

152 1 

.0108 

.2477 

.4196 

202 1 



1 .3169 

154 ; 

.0081 

.2336 

.4328 

204 i 



.3048 

156 

.0050 

.2198 

.4462 

206 i 


.0323 

.2928 

158 

.0042 

.2066 

.4596 

208 1 


.0281 

! .2810 

160 

.0028 

.1935 

.4731 

210 

1 


.0244 

1 .2694 




.4865 

212 



1 .2680 

164 


.1688 

.5000 

214 



.2468 

166 

.0006 

.1571 

.5000 



liH 

.2358 


(Tables for cases 9 and 10 can be completed by symmetry.) 


judged the value of r* significant, since tr^f ^ .213, and .213 is 1 gs.s than one- 
third of .68. 

Example 2, Six golfers found, upon ranking their scores and also ranking 
their respective amounts of sleep for the previous night, that the two orders 
were the reverse of one another except that the two ranking 1, 2 in sleep ranked 5, 
6 in score. Is the negative correlation too great to be reasonably attributed to 
chance? 

Solution; We find = 68 and, upon consulting table IV, P = .0083, so we 
conclude that more sleep might mean fewer strokes. 

Example 3. Before an examination a teacher ranked his class of 13 rnembers. 
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After the examuiation. he found that the sum of the sciuareg of the deviations of 
rank on examination from rank estimated was 144, Should he consider the 
agreement satisfactory? 


TABLE V 


Pain of values between which has a probaUhty, P, of being included 


N 

P ^ 

.99 

.98 j 

.96 

^ ^ 

.90 j 

.80 

11 


399.2 

68. 2 

381.8 

77.1 

363.9 

105,6 

334.4 


309.2 

12 


605.1 

82.4 

483.6 


460.1 

HI, 2 

424.8 

m.5 

393.5 

la 

93.8 

634.7 


608.4 

148.2 

679.8 

191.2 

636.8 


498. 7 

14 

195.9 

780.1 

101,4 

H8.e 


714.2 

347H 

662,6 

293.3 

616.7 

15 

174,6 

946.6 

211.8 

90S. 2 

262.6 

867,4 

313.8 

806.2 


761.8 

16 

227.S 

1132.2 

271.6 

108S.4 

319.4 

m 

391.2 

968.8 

465.0 

906.0 

17 

290.5 

1341.4 

341.4 

1290.6 

397.0 

H 


11B1.6 


1077.4 

18 

363.0 

1674.4 

422.3 

1516. t 

486.3 

1451.7 

682.4 

13SS.6 

667.8 

1270,2 

19 

447.9 

1832.1 

614.9 


588.2 

1601,8 

698.0 

1682.0 

|Hn SH 

1484,4 

20 

644,1 

2115.9 

620.2 


703.4 

1966.6 

828.1 

1831.9 


1721.0 

21 


2427.0 

738.9 

2341.1 

832.8 

3247.2 

973.6 

2106.4 

■BB SB 

1081,3 

22 

776.5 

2766.6 

872.0 


977.3 

2604.7 

1136,3 

2406.7 

1375,7 

2266.3 


912.5 


mwK 

3027,8 

1137.8 

2910.2 

1314.2 

2733.8 

1471,0 

2677,0 

24 




3415.7 

1316.1 

3284.9 

16U.1 

5088. 9 

1685.4 

2914,6 

25 


3907.Q 

■ !{!hhI 

3834.6 


3689.9 


3473.0 


. 3280,2 

26 

1418.2 

4431.8 

1664.1 

4286.9 

1723.8 

4126.4 


3887.3 

2176.3 

3674,7 

2 ? 

1621.1 

4930,9 

1781.6 

47^0.5 

1956. 6 

4696.6 

2219.2 

4332.8 


4099.4 

28 

1842.7 

B466.3 

2018.1 

53S9.9 

2209,8 

6098.2 

2497,3 

4810.7 

2752,8 

4556,2 

29 

2083.7 

6036.3 

2276.1 

6744.9 

2484,3 

5635.7 

2797.9 

6322,1 

3076,7 

5043.3 

30 

2346.0 

6645.0 

2663.2 

6436.8 

2780.8 

6209.2 

8132.0 

6868.0 

3426.2 

6564.8 


Solution: Entering table V with n = 13 we see that P ^ ,96 for a value between 
148,2 and 579.8, and that P ^ ,98 for a value between 119,6 and 608,4. There- 
fore the probability of not exceeding 144 by chance is between .02 and .01. It 
would seem that the teacher showed considerable knowledge of his class. 


CAIlNEaiE l^rSTITUTE OF TECHNOLOGY. 

































NOTE ON COEREUTIONS 
By D. B. De Luby 

When the value of a correlation coefficient is to be estimated from a set of 
N pairs of observations, (»,■ , y(), f = 1, 2, •>> N, the statistic ordinarily com- 
puted is, of course, tlie produet-moment correlation coefficient, 

r - sii/isiSi), where 

K If n 

BSi = S (».• - WS 2 ^T/iyi- Ufi « 8 i 2 = E (aJi - x){yi - y), 

in=l 

AT N 

NS='Lxi, Ny-YiVi, n^N-l 

i=l i=l 

However, when x and y are known to have the same population mean and 
variance, the precision of the estimate may be improved slightly by using the 
intraciass correlation coefficient, 

2 E (a.' S) (yi ■" f) 

r' = , 2JVf - E (*.■ + y.-) . 

1 

It may be of interest to inquire into the properties of an analogous coefficient, 
appropriate to the case of equal variances and different means. This coeffi- 
cient would naturally be chosen to be 

U = 2Si5/(8i -|- =® (2SiS2/(8i -H Sa)!?’. 

Obviously, | u j < [ r | . 

The probability distribution of u is easily determined, under the assumption 
that X and y obey a bivariate normal distribution. If x is their common vari- 
ance, no restriction is introduced by taking v = 1. Then the probability ele- 
ment of Si , Sj , r, is known to be* 

,X n ~' 271( 1 -p 2 )n/ a M (1 - r ) « dsidsjdr, 

where p is the correlation of x and j/. From this, the distribution of u can 
be obtained by making the transformation 

U = {2sifi3/(si + 4))r, = 2 siS2/($i 4" 52 ), = Si + Sa , 


A^Fishfir, Biometrika, Vol, 10, p, 510. 
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Under this transformation, the range of Si , hi r, determined by the inequalities 
0 < Si ^ i®, i = 1, 2, 1 < r < 1, is mapped in a two-fold manner upon the 

space -r < li < 1 ^, 0 < V < 1, 0 < w ^ For fixed w, u ranges from m to 1 
or from -« to 1, according as u is positive or negative, and V) runs fi'onl 0 to w . 
q'he probability element of ti, v, w, is found to be 


(n/2r 


t(n — 3)1(1 “ y'T-^ 






duditdw, 


and the distribution of u, obtained by integrating with respect to v and in, is 


Jf{l ^ p')''''(l ^ pw)'”(l - 



K 0, the distribution of u is identifial with that of r, the pvoduct-mom€int 
comlation coefficient (for p = 0), in samples of (N + 1) P9^h‘S of observations. 
Therefore j to test the hypothesis of independence ^ using the coefBcient U} the 
methods and tables appropriate to testing the same hypothesis, using the coefS- 
cient are available. The precision gained by using w rather than r is equiva- 
lent to that supplied by another pair of observations. 

In tile general case, the transformation introduced by K. A. Fisher,^ 

u = tauh p ~ tauh f, 
leads to the distribution element^ \ 

K sach'^iz - l;)dz, 


This distribution is invariant in form under varying f, and is effectively normal 
for samples of any siae. In all oases^ & is an unbiased estimate of f . 

The variance of z can be obtained by the following device. Denote by -r(2pj n) 
the 2 p-th moment of ^ about the mean, 



f(2p>^) = K 




secU” 


Integration by parts gives the recurrence formula, 

(2FT lf(2F-r2) ~ + 2, ft -1- 2)i, 


P ^ 


^Metron, Vol. 1, N. 4, p, 7. 

3 The distributions of for a 1 have been given by R. A. Fisher, Metron, Vol. 

1, H. 4, p. 8, 
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From this follows at once the relation 
/(2p + 2,n + 2) != /(2p -f 2, 1) 

’7(2p, 1) , /(2p, 3) 


- (2p + l)(2p + 2) 
= I(2p + 2, 2) 


P 


+ 


3“ 


" jw f ■ < ■ ■■! ■ 


/(2p, n)' 


w 


\ n odd, 


(2p + l)(2p + 2) + 


2' 


4 a 


+ 


/(2p, n) " 


n evea. 


The values of J(2p + % 1) -^(^P + 2, 2) can be found without evaluating 

the integrals, by letting n It can be shown that J{2p, n) ^ 

and hence lim /(2p, n) - 0 for p > 0. We obtain 


n-»«j 


f{2p + 2, 1) = (2p + l)(2p + 2) + ...|, 

r(2p + 2, 2) = (2p + l)(2p + 2) + . ■ .|. 

Hence, for all values of n and p, (replacing n + 2 by n), 

/{2p + 2, 7^) 

. (2p + i)(2p + 2) + ■ ■ -I 


n* 

Setting p = 0 to get the variance, 
= 1(2, n) = 2/1 + 


(n + 2)^ 


(n + 4)^ 


1 


Mi 


+ 


1 


' (n + 2y ' {w + 4)4 


+ 


00 


Therefore, making use of the fact that / ^ we find 

Jm I “in Jw—1 

that 

l/n < Mi < V(^ ~ 2), 

and from the numerical values of Mi for small values of n, it appears that the 
approximation I/(^ ™ I) is satisfactory in all cases» 

In the same way, it can be shown that 

< Mi < 3/(n 2)1 


Thus the method of transforming correlations to test for significance, used 
by R. A. Fisher in connection with both interclass and intraclass correlations, 
is available here also, and is, in fact, slightly simpler, owing to the absence of 
bias* 

The coefficient u can, of course, be used in all situations where the intraclass 
coefficient is appropriate, (when the number of observations in each class is 
two), and conceivably in a small class of other cases as well. The test of signifi- 
cance is simpler using u instead of r', and the loss of precision is negligible, 

Universitv op Toronto, 





IRTERIOK AND EmKIOR MEANS OBTAINED BY THE 
METHOD OF MOMENTS 

ByBiDwardL Dodd 

1, lDtroductiOQ~Th« SubaUtative Mean. A very general mean based upon 
aubsUhition vas proposed by 0. GiuidnL’ Briefly stated, this mean U of 
data ai , Xi , • • • , Xt , is a number which satMas some equation of the form 

(1) ^{Af, M, • < • , M) ■ 0(xi , Xf , • • , *»). 

If, now,* 

(2) U « F{ai,a!i, ••,»*) 

n an ea^fic^ expression of M , ^en for each value c which each of the argiunents 
ai( can take on, 

(3) F{c, fl, . • , fl) = c! , 

or at least one value of this F is c. 

Supper now tiiat F(xi, Xt, ,s») k my function of Xt, xi, ••• ,Xii, 
defined for at least one set of equal arguments c, end such that whenever de- 
fined for equal arguments c, at least one value of F(e, e, , e) c, Suifli a 
function, 1 have called a smbMulm mean Varioas extensions* are immediate, 
such as the use of integration in place of summation. Indeed, pomt aet func- 
tions or functionals may be used.* Here I tiiall supplement (3) by a fidrly 
common convention. If F(o, o, > < , c) u not oHgm^y defined, but as xi c 
timultaneously, linut F(x] , x> , • , x,) a c, m this case, F(o, c, • • • , c) will 
be Bstigned its limiting value c,— thue establishing continuity. 

2. Location and scale as means. The purpose of this paper is to investigate 
the nature of the means which arise when the well known litthod o/ Momenfs 
is used to estimate the values of two important parameters— >n(unely, the Iocbp 
ticn X and the scale a of a frequency function or distrfiiution 'Drese ue taken 
as associated with the variable x of the distribution thus: 

(A) F (x - x)/«. 

' 0 Chisuu, "Sul Concetto tfa motlni'* Perfoduo di tfotemaiico, Seneed, Voli 9, (1920), 
pp. 106-119 

'EL Dodd, "Internal and External Maone Aruing fiom the Scaling of Froquenoy 
Funetionfl," These Armob, Vol B, (1937), pp 18-!20 
' For an extension of Chisim’s results, see Bruno do Finottl, "Sul Concetto d) media, ” 
Aormifs diti' /mfituio Ilalum difh AUuan, Vol 2, (1031), pp. 309-309. 

^ E L, Dodd, "The Chief Chamcterletie of Btatiatiool Meane," Cowles Cominiaeion 
leaturo Celoni^CoffafePufifuanon, OonarolSeneeNo 206, (1036), pp 80-03 

1£3 
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The nature of the distribution is then “specified” by 
(6) y - «"’*(«')! 

where $ may contain other parameteiBi but in 4 the k and a appear only in the 
t' given by (4). For this mode of approach, the reader is iWened to A 
Elsher.* 

The other parameters which may appear in $ will not be considered in this 
paper. 

The parameters x and a are in general unknown and unknowable. Howeverj 
we attempt to get (dose estimates k and a, of k and a respeotively, from a set of 
observations 

(6) , • n , . 

To aocompiish this, we have to solve certain equations formed in some way from 

(7) i (® — k)/a, 
and 

( 8 ) V « 

These equations (7) and (S) result from (4) and (5) by substitutmg esUtnates 
k and a, reapeotively, for parametera x and a 
Now the Method of Moments equates the theoretic inoments'-those obtained 
from some such equation as (8) with t replaced by its value in (7)— to the 
moments obtained from the observation (0). 

For the following discusaiQn it will be useful to obtain, "awibary** moments 
from the ^(t) m (8) bifm substitution is made from (7). Such moments^ then, 
do nei depend at all upon the values ultimately assigned to k and a. It is sup- 
posed that 



so that 4)(0 ^vea probabihty or rdative frequency Here, far hnite dietribu- 
tions, $(() 9 0 outside the interval of the distribution We shall assume the 
existence of the first mmnent 



and of the vanance 


(11) ^ di - di - 

j— « 

and we shall assume that ff > 0, to eliminate a degenerate case 


' * R A Fisher, '*On tlio Mathematical Foundation of Theoretical Statistics*^ Philosoph- 
ical TVaa^dt'ons of tho Royal Socioiy of London^ Bonos A, Vol 222, (1031), pp. 300-SBB. 



MBANS OBTAINBD BT UllTHOD OF MOMENTS 


155 


For the empirical moments of (6), we write 

(12) Jt = (Xi 4* + • • • + X»)/tt “ SX{/n, 

(13) 8 = SX?/f» - 2(ar< - Zf/n + je*. 

These two moments are, by tbe Method of Moments, equated respectively to 

(W) **[(* -• k)/a]dir, 

(16) « a:^$[(x — k)/(t) (to 

a . 

But, from (7), (10), and (11) it is easy to see that 

(16) JIfi = k -{- (M, 

(17) « k' + 2kaji + aV + M*)} 
from which it follows that 

(18) M, - Jtfl =: aV 
Suppose now that r' is the empirical varianoe, 

(19) r’ « S{Xt - 2)*/n. 

It follows from (12) and (18), that if Mi Jt and Mi » S— as the Method tf 
Moments requires — tben 

(20) a* - rVff-* = (t/v)*. 

And, from (16), 

(21) k = J? - aa 

These results may bo expressed m the follomng theorem . 

Theobem I, Th? estiiwtUd eatle a in 

(8) p = a~^(f), 

whBre hy (7)j i ^ (x ^ k)/a, oa Ma/tned by ihs Melkod of Moments from cbserva- 
tions Xif X%j * • t Xn $ is Uie roci^ean s^^uare of \Xi ^ | /a, where X ia the 
aHihmettc mean qf the Xi% and is the variance of $(i) ikdifj as a 

function of t—mth no reference to the k or a in (7)* 

Moreover, the estimated location k is a substitutive msAii, oharocterized by 
(3), and given by 

(21) k = Jf - aM = X - m - 2)V<^n]*. 

As regards this final Btatement, it will be seen that if each Xi ^ e, then X - c; 
and hence k = c,— as required by (3)a We may say, then, that the right mem- 
ber of (21) obtained as the fomoL solution of equations which the problem Bets 
up, is a substitutive mean of the elements Xi , 
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But U uadi Xf ^ then a » 0 in (21); and thia a may not be used aa a scale 
However, if any two XiS are different, a ^ 0 And it le evident that as X« c 
BimultaneouBlyi limit k = e If, then, we consider that the right member of (21) 
IS not ongmally defined for equal values c of the elements , it is to be given 
its **coniinuit/^ value c, in accordajoce with the oommoFn convention already 
mentionedi 

In the speoial case where the function $ in (5) chosen to specify the distribu- 
tion baa a first moment /i equal to zero, the estiinate k of location given by (21) 
is seen at once to be the arithmetic mean of the observations Xi , Xa , • • i, Xn 

3 External means* In the papers cited, Chiaini and DcFinatti gave ex- 
omples of external means Indeed, it is not difficult to find means lyhicli do not 
oonform to the condition of internality; 

(22) Minimum (X#) S Mean (XO ^ Maximum (X^), 

As a simple illustration, suppose that there are just three measurements Xi » 1, 
Xa » 1, Xg - -2 The standard deviation V? la greater than eaoh measuie- 
ment— lb is an external mean* In this case also, the eBtimate of scale mentioned 
in Theorem I is an external mean of (Xc - X)/(r But, it may be noted that a, 
the estimate of scale, is an trUemd mean of | X{ X \/ff 

However, it will be shown now that the estimate k of location may be on 
external mean, with an extormbty mi "removable** by the simple device of uting 
abaolute values. 

And it may be noted that in the earlier paper cited, I found by the M^od Gf 
Mctaiimm Likelihood estimates of the scale a, which were likewise not removable 
Thborbm 11. If for the function $(0 in (8), the second moment is less than imee 
the s^uasre cf ihe second TnomcTtf, then Oie ealvouAed location gtven by 

(21) k X aja 

IS an external mean qf the measurements Xi , if these are all nimBricaUy equalj 
half of them postim and the other negahve. 

Proof Let the positive meesuremeiits be c, and the negative measurements 
be Then X » 0; also m (19), t » c Hence from (20), a « e/o But by 
hypothesis, the second moment + ft* of $(0 in (11) is less than 2ft^, and thus 
Ip/tr] > 1, Then, by (21) k =* X — oju *= (-fi/a)/*; and hence |k| > c. 
Either k is greater than every positive moasiiTement e, or it is less than every 
negative measurement -c* In either case, it is an external mean 

CoROLiiARY 7/tn$(0j the t is suhfedeA to a translation t = u + b, so that 
$(0 =* ^(ii + b) ^ then it w always possible (o choose b so that the second 
moment of ^(w) w less twice the square of tts first moment] and thus if a 
hcoHen k' %s ohimml from cacferrml faeaiis may occur On the other hand, 
by proper choice of b, it is possible to make the first mommti zero^ so that the bm- 
tion becomes the anikmettc mean Xqf the X{S 

The first part of this corollary may be seen from (11) which states that Second 
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Moment = ;*“ + cr** Translation does not change ir®, but it can increase pf 
indefinitely, — making eventually pt* > v® and thus /i® + < 2jit® 

4 liluBtratlon. For the Pearson Type III the simplest speoifioation la per- 
haps with the origin at the start In this oasOi 

(23) Ht) « P > “1, i = (a; - k)/a. 

Here p! ^ r(l -|- p) Apart from this numerical factor, is the integrand 
of the Gamma function. With $(/) m this form, it ia easily seen that the first 
moment is (p -|~ 1^) i^he second moment is (p + l-)(p + 2) Iti the usual® 
case, p > 0. Here, then, the eeconU moment ia less than twice the Equore o£ the 
first moment. If, then, there ore an even number of measurements, all numeir- 
ically equal, with half the measurements positive and the other half negative, 
then the estimate k of location as found by the Method of Moments is on ex~ 
Usrndl mean of the measurementa. Such conditions, while sufficient, ace by 
no means necessmy for externality 

5. Summaryp Suppose that the specification for a frequency function in x 
is where i' = (a: — K)/ay and that for the unknown scale or and location 

Kf estimates a and k, re^ectively, ore made by the Method of Moments from 
a set of n measurements Xi with arithmetic mean Let v® be the variance of 
Then the eBtiinate a ia the loot-mean-squore of | | /v, an internal 

mean. The estimate k of the location is X — ga, where p is the first moment 
of This ia a substitutive mean of the measurements Xt ; and it may be 

external — cither greater than Maximum Xi or less than Minimum Xi . 

Tiifi Univbrsitt of Tsxab 


* W. Palin Hlderton, Freguanev Curves and Corrslaiiont Second Edition, p Q1 



ON THB CHI-SQITAHE DISTRIBUTION FOR SMALL SAMPLES* 

By Pm G. Hobui 

1, Intfoduction, The use of what is known as the ^ distribution function 
for testing goodnhss of fit involves two types of error. One arises from the fast 
that the derivation of this funotion is bai^ upon rough approxunaUonSj wMie 
the other arises from using the integral of (his continuous function in place of 
summing the proper terms of a discrete set, Both of those errors become in- 
creasingly important ss the sample becomes small The purpose of this paper 
is to investigate the nature of this first type of error by finding a bettor approxi- 
mation than the customary one to what inight be called the exact oontinuous x* 
distribution function. 

The method employed is that of generatmg or oharaoteriatio functions, and 
consists in expressing successively in expanded form the generating funotion of 
the multiuoinial, the distribution function of the multinomial, the generatmg 
function of %, and the distribution funotion of x Only the first and second 
order terme of this final distribution funotion are evaluated explicitly beeause 
of the increo^n^y heavy algebra involved. By means of these second order 
terms, the nature of the error involved in the use of the customary first order 
approximation is investigated. 


3 The Generating Function of the Multinomial. Consider k -f 1 cells 
mto which observations can fall, and let pj be the probability that an observa- 
tion will fall in cell %. If » observations are made, the probability that cell t 
will contain at of these observations is given by the multinomial 


fil 


ad 02! ' ‘ 


pf’pr 


y-i 


where a< - n The generating funotion of this multinomiel can be wiit- 
ten b/ 

M ^ [pie’’ + • > + + pl* “ fi + ^ Pi(s** “ 1)1 ) 

I 

where of^+i ie chosen as the dependent variable and pM is written as p. 


‘ Presented to the Amenofln MBthematioal Sooietyj April 6| 1988. 

* Gf DnrmoiB, MaihmniiquQ, pp. 29l7''242, for the msthoda used in this and 

tho next painirnpltiii 


1 « 
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I 


Let xj = “* gsnetatbg ftmotion of the Xi is obtabed from thsrt 

of the m by multiplying M by the pippex faotot to shift the ongm to the mean 
and then replacing ti by, say, tif/Vfl to coRipensate for the change in scale 
Denoting this function by 

-n S r * 'll* 

^ B a 1 1 + g - 1) I . 

Coneequontlyp 

log <p = - V5 2^ piUi + n log [l + £ - 1)1 

/-I L J 

3inod the range of the may be aeleoted sufficiently small for convergence, the 
logarithm on the nght may be expanded in powers of the summation, which in 
turn may be expanded in powcia of the ut Terms contoixung 1/n^* as a factor 
will be homogeneous in the Ui of degree q + 2. Writing down only the terms 
of order 1/n and lower, this double expansion gives 

log (P ■ iFz (pi - p!)u( -22 piPiUfU#] 

2L*-i <« J 

+ 4=.r 5 2 (Pf " 3p’ + 2pS)u5 - 5 2 (ptJV - 2p?P/)uiU^ 

+ 22 PiPiPiUiUjUil + ~ ^ 

«#<« J n 1*4 i-i 

(1) - s £ (PiP/ - flPiPf + flp!p/)u{u/ 


“Is (pipj “ 2p5p/ - i^(p' + 0p*p’)u!u; 


+ 2 (PtPiPi - 3pJpjPi)uiUyU( 




+ 6 2 P(PjPiP«u<UjUiU« + 

J 


Hence ^ can be written in the form 


( 2 ) 


9 



i<i 


\ 



1 + 


ri| } I 

V — “i » 

n ii 



j 


where Ai is the coefficient of ^/^/n in (1), Ai is the sum of the coefficient of 1/n 
Olid Aj/2, etc 
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3 The Multinomial Distribution Function. If a distnbution function can 
he expresBod as 

(3) + 

-i2« « M 

where /« is of theforrocbe"*" ‘ with j cj/1 positive definite, then its generating 
funobon* can be written as 

r » 1 

(4) P(tt,, . , u*) * I + E «iUj + Ti do«iUi + ■ ‘ . 

L <-l M-l J 

where Ft is the generating funotion of /o and is of the form e | aif \ 

positive definite. Conversely/ if the generating funotion of a continuous dis- 
tribution IS of the form (4), then the distribution function oan be expressed by 
means of (3), Tliis relationship may be applied to (2) since it can be shown to 
be of the form (4). 

The coeifieients of /tk eorresponding to ip can be determined by making use 
of the fact that the moments of /q can be evaluated directly by integration or 
indirectly by differontiatioa of ^ It is suflicient here to equate expressions 
for second moments) thus 

I 

= r. f dr* 

Now 

0^ VQ _/""PjPo 

dUf^Uf m-0 iP# ^ P«i S — i 

The value of the integral is known* to be the reciprocal of the element Ok 
m the detarmmant | 1 . Hence ' 

\pt'pl, a=< 

But Crt can be obtained from dnee it is given by the reciprocal of Thus 
Cji = 6*V 1 I , where 6** denotes the cofactor of element c"* in ) c*' ) . 


> DarmoiSj Icg. at., p, 242, 

* See, for example, S Kullbaek, AnmilB pf ilfalhamttcal SiaMtes, vol 5 (1984), pp 
269-907. 

^ Bee, for example, lUBBer and Traynard, Let Pnneipet de la Slaltsiique MtUhematiquef 

p. 226. 



CHI-SQUABU DtSTBIBUTION BOB BUALL BAUPLBB 


161 


- Pi ”PiPi • ~PiP* 

p» “ P« • ~?^P* 


Pi - Pi 


- 1 


= {"i)*pipr..pi 


1-- ... 1 

pi 


1 _i 

Pk\ 

This dfitcrmiiKuit may be evaluated by eubtmotmg the last column from each 
of the others and then expanding by minors of the last row. Thus 


i-Zpi 
pi (-I)*-—— 


Pi . • pjt 


ss Pips ■ • • p^p, 


■w 

since ^ 1 — p from probability considerations To evaluate b*\ delete 

row s and column f in | c*' | j then shift row t to the lost lOw and column s to the 
last column. These shifts, together with the sign of the cofactor, change the 
sign of the resulting eiqiression; hence 


1 -- 1 
Pi 


i 1 

„ - ( i)*~^ Pi ■ ' ‘ p* 
~ ' p.pi 


1 -- 
Pi 


Pipi • • ’ p*i 


i-~ 1 
Pk 


provided e (. Since t“ is merely [ c" | after row s and column s have been 
deleted, it may be evaluated exactly os was | o'* j • Thus 

k 

1-2p< / -\ 

.. (_!)*-> -^!!!^ - p,p. . . . pJi + J). 

pi L Pi ' • * P* J \ Pi/ 
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Combining these results, Cti 


-for fl ^ £and(!it 
P 


i and therefore 
P PB 


( 5 ) 




By oomputing the necessary derivatives of fc , the explicit form of /, given by 
(3), can be obtained to the desired number of terms Since such derivatives 
contain/o as a factor, / may be written as 


( 6 ) 



Bi 1 fl* 



t 


where Bi is obtained from Ai of (2) by replaoing tetms in the Ut with the eo^ 
responding derivative of /o and then faotonng out /o . 


4 The Generating Fanction of l^t this function be denoted by 



consequontiy ^ is, except for a feotor of — the quadratic form in fa . Ac- 
cording, letring $ 

and hence 



Lotting ffi aB and denoting the value of Si after this aubstitutioa by Ci^ 

m =ir» r r/oFi - § — 

/“o® L vn 

1 + g j /o^sdi^ * * • (teji, + ' * ' J * 

since the terms involving odd powers of are of odd degree in the Zi and 
therefore vanish upon integration. 

For the purposes of this paper only the integral which is the ooefflcient of l/n 
needs to be evaluated. Since the algebra involved in this evaluation is heavy 
and the fonnulas become exceedingly long, only a few terms will be written out 
explicitly to indicate the prooedam followed. 
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From {l)i {2)j and (6) it is clear that only fourth and fiucth order dorivatives 
of /o are needed As examples , 

g .;{i« -,«>!(! +i) + 4 «>i(l + i)’ - i.(i H-iJ], 

where -O* = “ iff + * * +»* J Following the procedure 

indicated in (6) and (7)f this integral becomes 

/ " / •^* 1 ^ S 

["-“fC+sl+^O+s)’] 

(similav terms of degree 4 and lower in the Dt) 

(8) 1 A 

+ ~ £ bi - 6p? + 13p1 “ I2p! + 4j)1l 

72 <-i 

[?-“pC-+^ + ‘‘?0 + 5)’-“C-+s)'] 

+ (similar terms of degree 6 and lower in the I>{)| dii • • dsh 

When 9 1, the integral reduces to that of /oBs , which in. turn iB the integral 

of a hnear combination of derivatives of fo But tlie integral of such a deriva- 
tive vanishes, As a result, U the integral of JqD] has been computed directly, 
that of /flD} and then that of /oD{ con be found indirectly by equating the cor- 
responding bracket to zero for ^ « 1. Similarly for the other terms of the above 
integral. As examples 


£■£ 

L" L 


~ + i, 

V pi 


i(iD\dz\ • • • dzk = 3 


(- + “Y. 

\P w 


Upon evaluating all such integrals, (8) reduces to 

^ I fe - Tp ! + - 1 ^) 4 + ^’(1 - 1 )‘ 


<9) 


•f tercuB &U coateiniiig ^ aa a fautor j 

+ 4 g (pf - flp! + 13p| - 12p! + 4pJ) 16 + iJO - 1 J 

+ ^aunilar tenna all contaimiig ~ ^ ^ factor j 
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In order to interpret these reaiiita, it is neccesary to condense these various 
Bums of probability expresaons. If the terms are arranged in descending powers 
of the Pi , it will be diecovered that cettMn combinatioas condense readily, 
The eonden^ioiL in each case lies m recognising combinatione like 


2p* + 4 E pip* + 6 Ep?p* + 12 E, pfPfP* 

+ 24 E pfPiPtPm 



However, some of the terms resulting from multiplying by l/pi above cannot 
be condensed m this fashion until they have been reduced to familiar sums by 
using relaidonahipfi of the following type: 



After all possible condensations have been made, (9) reduces to 

+ 


i\ + 12* + 6)1. 

\fl / 24L <-iPj J 


Aa a result, the generating function of x* con be writtm oa 

i 

o(j) . + ^' 

H 



+ ^ - 39-“^*' + 

fi 



-j- (terms involving higher powers of 1/n), 

where 5i « i[S W ■ ^*^ + ^ + - (3*? + I3fc + 3)]. 


6. The Distribution Function of It is well known that «= (1 - 21)“^* 
is the generating function of what is commonly called the x* distribution funo^ 
tlon with h degrees of freedom. If this distribution function is denoted by 
FifeCx*)! then the distribution function corresponding to (10) can be written os 

(H) ^ ^ 

+ (terms involving higher powers of l/n), 
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' Hie customary test for goodness of fit mvolves the integral of Fi,(x*) from 
X to eo , which has been tabled for values of and k. The form of (11) is suoh 
that the integral of the term in 1/n is easily evaluated by means of t^ some 
table. However, for more accurate results Mid for theoreUod reasons, it is 
more duoidatiqg to express these integrals in a more oompaot form. This is 
accomplished by using fomihor' expansions for the integral of De- 

noting the integral of the cxplimt tenns of (11) by P, it is easy to show that 

(W) P-Pi+-lBiSi + R,fi,l, 

n 


where Pt is tho oiistomary tabled value for k degrees of freedom and 


(13> 


8. 


fl,=' 




9-**V 


[x‘ - (S + 2)i, 


2.4- •(ii + 4) 


2.4 * * * (fc + 2) 

[x^-2(fc + 4)x’+(fc+4)(fc + 2)l. 


for k oven, while for k odd both and As oontain an additional factor of y/2/ir 
and have 1.8 » {h -^2) and 1.3 • (h -|- 4) reapeotively for denonnnators. 


6. ConclusionSf In any given problem the second approximation P can be 
oolculated easily by naeona of either (11) or (12) and compared with the cua- 
tomary first approximation Pj . However, the magnitude of this correction 
term la of primary interest wlien x la near a significance level and when one 
or more of n, k, and p{ is small because the accuracy of Pi is questioned in 
those cases 

For X* at the .06 level and for 2 ^ ^ ^ 16, it is easily shown that 0 < JRi 
< .08 and - 08 < As < 0 Clearly Sa is positive, while St will be positive if 
one or more of the Pf is suffidently small Consequently, for those cases of 
particular mterest, the correction term is surprisingly small partly because 
Bi and Ra are so small and partly because they are of opposite sign 

To illustrate this viewpoint consider the following numerical example Let 
71 = 10, fe =a 4, X* “ 9.488, pi “ = Af Ps ™ 'A’l “ Aj 3>fi = a Then 
Si = 2.23, Ss = 638, Si * .060, As = - 027, Pi 06, and P ^ .046 The 
correction term of — .006 is very small in spite of the fact that this example is on 
extreme case to which the customary x* test would not be applied. 

As Judged by the second order approximation obtained in this paper, the 
actual error comitted by using the customary first approximation is much 
smaller than the order of the neglected tenns would indicate, and therefore 
'the range of applicability of Pi is wider than has been supposed However, 
this investigation has considered only the error due to rough approximations 
and leaves untouched the second type of error indicated in the introductory 
paragraph 

Oancox Statu CoLLxaH 


‘ Rifiser and Traynard, loo oit , p 26L 
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SHORTEST AVERAGE CONEIDENCE INTERVALS 
FROM LARGE SAMPLES 

I 

Bt S S WiLKfl 

1 Introduction. The method of fiducial argument [1, 2] in statietios has 
gamed considerable prominence trithin the last few jrears as a method of inferring 
the values of popidatioa panunetors from samples ''randomly drawn” from 
populadons having distribution laws of known functional forms. The method 
has also been shown to be tqiplicable [2] to the proUem of inferring the values of 
statisUcal functions hi samples from samples already observed, assuming all 
samples to be drawn from a population uith a distribution law of a given funo" 
tionalform 

The main ideas of a procedure nliirh ih sufficient for carrying out fiducial 
mference for reriain oases of a shigle population parameter may be summed up 
in the following steps; 

(a) A sample is assumed to be “randomly drawn” from a population with a 
distribution law /(te, 0) of known functional form 

(b) A function tl’(xi » « ten ■ of the sample values XnXt, • , Xa and 
parameter 0 is devised, which is a monotomo function of $ for a ^ven 
sample, so that tlie sampling distribution G(^)di> of 

th I aayi in samples from the population with tt ^ dg is independent of 
^ and tiie z'a, except as they enter into ^ 

(o) For a given probability a a pur of numbers and is chosen so that 
when <1 a Os, the probability that ^ a, or mote, briefly, 

(1) < ^" 1 0 = i^) = 1 - a 
which can be stated in the alternative form 

(2) P(e < fti <0)0 = Ob) = 1 - 

(d) 0 and 0 being funetions of tjtg , and the sample, are subject to eampling 
fluctuations ond it con be stated that the probability is 1 - a that they 
will include the true value of 0, wliatever it may be, that is, 6t , between 
them. The statement holds for all values which Oo may take on. . 

The numbeis 0 and i are known as fiducial or amfidem hmds (3] of Os ana 
il) a a)t}fidem tnierwl for the eonfidem mJlieitnl I a. We therefore 
have the following nilo for making infermcea about tiie unkmwrn number Os 
once i> has been found; For a ipven sample solve the equations 

, ft. . flr, , Oij = , ^(xi , ft , > , X, , ft)) « 

m 
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for 00 Let d and 8 be the two values of ^ formally obtained, The statement 
that 0 and 8 will include the value of 0 in the population actually sampled, if 
Qonsidtently made in each of an aggregate of cases involving populations having 
diatributiona of the sama funotionfll foi:ni/(ajj 9) will be correct (theoretically) 
in 100(1 — a) per cent of the cases. 

If ^ 18 a function of statistics ti and of two samples from a population of 
known functional form, which is monotomo m each t for given values of the 
other, then one can argue Mudolly about values of one i from values of the 
other one. 

For a finite value of n and disorete distributions /(tc, 0), it is not possible to 
carry through steps (b), (o), (d) as they are now stated. However, under 
certain conditions, it is possible to carry out a procedure for the discrete cese 
which will allow one to aay 

(3) P(0 < 00 < 8 1 0 ^ 0o) > 1 “ 

^ functions which have the property that their seunpbng distributions ore 
independent of 0 and the a;*a for a given distribution /(a;, 0) are not, in general, 
unique, The question then ariees as to how (if possible) one can choose ^ 
functions and limits and so as to get confidence intervals for a given a, 
wbidfi are shortest or ^'hesV' in some sense. Keyman [4] has investigated the 
problem of obtaining "best’* confidence intervals for the case of small samples 
The object of this paper is to consider the problem for large samples Under 
fairly general conditions it will be seen that a rather eimple asymptotio solution 
exists for the large-sample case, which is connected in an essential manner with 
the method of mopAmvm lihdihood, 

2. An asymptotic distribution. Suppose a population n has a distribution 
function /(oi, 0), where is a random variable and 0 a parameter Actually, 
f{Xf 0) may involve several other parameters whose values may be regarded 
as fixed throughout the paper. The problem of arguing fidudolly about several 
parameters simuItaneouBly will not be considered in this paper. In order to 
include the case of a discrete as well as a continuous variate x, we shall consider 
the cumulative distribution function (c d.f.) F{x, 0), which is monotonic and is 
such that 

00 ^ e) « 0, F{+ 0) = 1, F(ic H- c, 0) > F(®, 0) 

F(x + 0, 0) = F(Xf 0), for c > 0, and a < 0 < b, 

Thus, Fix't 0) «« P{x $ 1 0). In the cose of a continuous variate x, where 

fix, 0) IB a probability density function, then dF{Xf 0) — fix, S) d«; in the discrete 
case dF(x, 0) = fix, 0) where /(x, 0) is the probability that vanate x takes the 
value indicated. We shall be interested in continuous functions <pix) for which 
the Integral / dFix, 0) taken in the Stieljtes sense exists. Limits on integral 
signs are understood to be - eo and bo. 
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r 

Now couaider a flomple 0» of n individuala independently drawn from lla , 
the population for which the c,d<f is F(jt^ fit). Let tho values of s in the sample 
To9«i,xt, ‘ ,s». The probability clement aasooiatod with the sample is 

(4) 

rf*-l 

let L = log dP, Then assuming that ^ log d P{a, S) m g(jt, 0), gay, exists for 
fl = do , and for each a, (except for a set of probability 0), we have 

(6) M ^ 

00 

In all ordinary problema in Btatisfcica {?(», 9) redneos to 9) where 

f(a, 9) is probability in the case wbera ie is a disorete random variable and 
probability density in the case of a continuous random variable. Lot ffo denote 

( 9JD\ * dL 

■— ) denote ^ with fl * dt . Let 
00/0 00 

(6) AJ =“ BoKptt)®] ™ J flfl), 

£o(^) will be used to denote the mathematical expectation of 9) in samples from 
IId , 1 e* when the population distributioiL is dF(a:, tfq). We shall oondder the 
sampling theory of 

(7) V'o =“ \6fl/o 

m large samples^ from Ho 

Let be the characteristic function of for samples from Ho } it is 
defined by Then 


■ (^[‘ + TO ■ ■*■ ii"*'* + ■*■']} 

where and h ore reed functions of i, x, n aud Oo , such that if | Boigif | ^ -K < <« , 
(1 e. the third moment of go is finite when d ^ fti), for a < 9o < b, then 
and are unifoinily bounded for some t-intmal Sfwhich includoa t 0 
as an interior point) for n larger than some no and for 9o on any fixed subbterval 
of the intervfd (a| b) Suppose that 9) is such that 

(fi) j ^ ^ j 9 ) ^ 0i a < 9 < b 

This Qondition implies that the range of x be independent of 6 
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If ifl allowed to increase indefinitely, then wehave at once that tends to 

6 “**’ uniformly in the interval S, We now make use of a theorem [ 6 ] which 
states that if an unlimited sequence of random variables * 

with od.ff^s ^***(x), •• , • * have corresponding characteristic 

functions * ‘ <^*^***(0 • • then a necessaiy and sufficient condition 

for to converge uniformly to a c,d.f. F(x) at each point of continuity of 
F(a) on the intorval (- oo, 09)19 that the sequence of oharaotoristic functions 
converge uniformly to a function ^i(t) on an interval \i\< s for some f > 0 
The characteristic function ^(f) associated with ^(x) will then be identical with 
yi(i) and the sequonoa^^^Ct), • • • • converges to y(t) uniformly in every 

finite ^interval. 

From this theorem it follows at once that, since is the oharaoteristic 
function of a variate distributed normally with mean 0 and variance 1 , the 
asymptotic c.d.f of ^0 for largo samples is given by 


We may conveniently summarise the foregoing results m the following 
Theobxm 1. Let Xi j Xi , • • • , Xn be the wims 0 / x in a sample qf independ- 
ently dram indimdmUfrm a populaUon Uo whi(^ hasae d/. F(x, ft), suA ihai 
for o < ft < b, 

Q 

(a) — (jF(x, 0 ) emstsfor aU x's except possibly for a sd of prohabthty 0; 

w 

(b) JSo[(g!)) tsfiniicifor n > no, 

( 0 ) condikon (9) is sakefi^. 

Then (he asymptotic c,df* cf for large samples defined tn (7) ts given by (10)« 
The statistical sigaificancG of this Theorem is that if we know the functional 
fonn/(®, (I) (for which the first derivative /(x, 0 ) with respect to 0 esdats) of the 
distribution function of a population H and if the sample xi , xi , * » « , x^ is 
“randomly drawn” from Jk , then the quantity 



is a random variable which is approximately normally distributed with mean 0 
and variance 1 in repeated large samples. It will be noticed that the quantity 
in the numerator of ( 11 ), is simply the derivative with respect to at 9 = ft , 
of the logarithm of the likelihood of 6 for the given sample ^ is a function of 
the sample On and the true value ft of the parameter ft and the thing that makes 
a random variable is the random natui^ of the sample; ft is a fixed but un- 
known number* Thus, for example, when 1 - « =* 96 in ( 1 ) and knowing 
that w© have “randomly drawn” a large sample 0 ^ from a population Ho with 
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distribution /(a;, 9i) of known fuiiorionnl fonn^ we can say that the probability is 
.96 that the sample will produce a value of in the interval -1 06 to -j-l.ge 
that is, 

(12) ?(-1.96 < 1^0 < 1.96 \0^en)^ .96 

This statement holds, whatever may be the value of the unknown 6b Now, 
the inequality -^1.96 < ^ < 1.96 is equivalent to the inequality, ^ < 6 

becauee of the monotonlo nature of os a function of . Hence (12) is equiva- 
lent to 

(13) ?(a < ft, < 5 1 ^ ft) = .96 

where 6 and 9 are obtained by solving = =h 1.96 for ft . The fiduaal Zinitfs 
6 and 9 will thus be functions of the sample and will be subject to sampling 
variations. In general, of courso, one could choose any probability level 1 - a, 
and find so that 

(14) P{-h < < if'a 1 * ft) = 1 “ a, 

from which fiducial limits for ft can be found es before. 

Tlie extension of Theorem 1 to the case in whioh the distribution function of 
the population 11 involves several parameters ft , ft , • - ft having values m 
some reckon R of the space of 0% is immediate. Ho in this cose would be specified 
by the values 0 ld i 9 sd j • • • 9 m . In fact, we eon state the situation as 
Theoeexi 1'; Let F{Xt ft , ft , • * , ft) denote (he c.d/, oj x and (flUovdng i, i 
to take Oft valuee 1, 2, - * jK)let 

1 /dL\ ^ 

^ * 10 , Am, « , «(io), 

ffi* •■|*»)!» 


Aif = i^DlETAiff jo] wAere ga = gt mih Bt => Bn. 


If, in fi, 




• ft) exists for all x*s except possibly for a set of probabilUy 0; 


(b) E^igiogi^tgui) are aU finite; 

(c) ^ j fti ft, * * ^ , ft) = y ft, ft» • ' * , ft) = 9 

(d) llA^^llunon-stftgufar; 

then ike osympioliG disir«&ufton of ike in large sumples frovn II« ts a nortwd 
tttttUtvarude disZrjhtdion wdh matrix || ilf / 1| o / variances aind covorianees^ and zero 
means. 

A timilariheoTem holds for the cose m which 11 is a multivariate population m 
addition to having several parameters. 

The question now arises: In what sense is the confidence internal between $ and 
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9 ofl determined from ^ It will be shown that the average rate of 

change of with respect to 0 at 0 = Ai is greater than that for a rather broad 
class of functions of the ^ type, that is funotions of the observations and $ which 
ore asymptotioaUy normally distributed Since we are dealing with large 
samples, we are only interested in values of $ in the neighborhood of , for 
which ^ as a function of 0 is approximate Ihiearj and demonstrating the prop- 
erty just stated regarding the average rate of change of ^ with respect to $ at 
d - ^ is equivalent to showing that the two ' Vahies’^ of for which , 

will, on the average he closer together than those computed from any other ^ 
function than ^ of the class of functions to be considered. This class of func^ 
tions will be designated as belonging to class C, and will now be more accurately 
defined. 


3 Functions of class C and their asymptotic distributions. Following an 
argument mmilar to that used in proving Theorem 1, we can readily prove 
Tueouem 2: Lei B) 6e a funefton in mkieh z has the e d/. F(Xf ^), and 
vdiick saHsfies ikefolloioing catidiiiona for a < 0b < h; 

(16) (a) Ad)] =* Oj 

(b) Eo[(h(», 0o)l*] »s for ft > no . 

Lei 

( 16 ) Ao ^ Fotih{®, Aii))*l 

and for a sample of values fE| , aib , ' * * , dfn lef 

/1It\ I* 5w ^ (it’ll ®l>) 

(17) ^0 “ J 

, VnAt 

The\^ the atsfmplotto cif <l>* for large aampZes ^Vom St is giuen iy 

We shall designate as belon^g to class C any function made up according 
to the rule expressed by (17) i of functions h{Xf fl) aatiafymg (a) and (b) in (Ifi) 
and such that is aaymptotioally normally distributed with aero mean and 
unit number, Clearly, as defin^ by (7) belongs to class G, 


4, Comparlsofl. of avatogo confidenoe Interrals oooiputed from ^ and , 
We shall now show that for each fixed value St of S the average rate of change of 
^ with respect to 8 is greater than that of rj/* tor any h(x, 8) which is not a con- 
stant multiple of g(a;, Consider ^ and for a given ». We have, 


( 18 ) 

(19) 


3/' ^ 1 r 5g(ai, B) 

88 1 1 
^ 1 Oh{tt,, 8) 

88 ” VnA* 1. 1 89 
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& B wiiiKe 


Now 


8g(^) ^ ^ j ^ - \g(st, e)f 

8® 9®l ®® ' J rff(®(,fl) 

Assuming tlmt 

(20) J ®) - |i/ ®) - 0 

and remembering that ^lolg^Ci , ft)] =« 0, we fanve 

(21) ^‘[(wJ * *“ 




NoWj Biace 


/»(*, 


9) dP(J5j 6) =* 0 


and assmxiing that (23) can be differentiated under the integral sign, we have 

a.) a[(^).]-[-/MM)i<*«.,.)]^. 

For the difference a! — Ai in samplea from populations with 0 ^ , we have 




ff))* dF{x, S) 


- I (ft(*, ®) VdPi!t, e)) 






Making use of Sohwartz’ inequality which states that 

j j*({b) dx * j t?{x) dz > ff(ap) h{x) da;J*, 

where the equality sign bolds only if jCx) ^ K h(x)f K being a constant, it is 
evident that independently of n, A? S A* , and furthermore, the only condition 
under which aJ ^ At is that 

aJ 
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that ifij 

(26) h(xj 0) g(Xi 6), 


Therefore we have 

Theorem 3* 1/ gix, 0) and h[x, B) Bolisfy the conditiom of Theoretna I and 2 
respeclively and furUiemoret if (20) ia aoiia^ and if the exprea&ion on the l^t in 
(23) ean le differefdioted under the irUegral sign with respect to 6, then the amage 
rate of change of ^ with respect to 0 for each fixed value Bq of 0 is greater than that of 
if* (for which fe(a:, 0) Kg(Xf O) with reaped to when 0 - 6o inamplesfrom ITo * 

This Theorem simply moans that when computed from the fidndal liimts 
for the true but unknown value Bq of the parameter whatever value may 
have on the interval a < 9o < b of posdble values^ are (for large samples) closer 
together on the average than those computed from any other of class C, 
There ia no function if* which is more efficionii as it were, for determining con* 
fidonce intervals for than the particular ^ven by (7) which is it with 

h(z, i) replaced by g(x, 6), that ia, — log dF(X/ ff). The Actual manner in which 


the fiducial Itmita for 0b are found for a given confidence eoefiSciBnt 1 
to set 


(27) 



VS A, 




and solve formally, for A, , where is the value for which 


2 /■" 
V^i#, 




— Of, is 


dx = 


CKi 


which can be found from normal probability tables. The two values of Bo thus 
found are the fiducial limits 0 and $ for the true value A) and we can state that 
the probability ia 1 ^ oc that 0 and S will include the true value 0o between them. 
This statement ia valid wbatev^ may be the value of Bo between a and b. This 
rule consifitently followed for layge eamplea, will produce fiducial Umita € and § 
which are olosest together on the overage, for ewA fixed value of the probability 
level ’a between 0 and 1. It should be observed that no assumptions have been 
made regarding the existence of sufficient statistics. 


5. Examples. I^ample 1* Suppose a large sample of n individuals to be 
drawn from a population known to have the Poisson distribution law 


/(a;, 7w) = 


m'e^ 
x\ ‘ 


L m -log (n^lj + (Siw) logw - ftW 

( — ^ -- n 

\bw/o mo 


We have 
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The fiducial limits m emd m for a ^ *06, that is, the 96 per cent fiducial limilB, 
are found by foimnlly solving the equations 




" ±1*90 


for mq. 


The fiducial limits are found to be 



SxAMPLja 2* Consider a large sample of n individuals known to be from a 
binomial population having (he two classes A and S, Let p denote the proba^ 
bility of an individuara belonging to Ay and I ^ p that of belonging to fi. 
Let X denote the number of individuals bdonging to A in one drawing from the 
populaHon; x will take on only two possible values, 1 and 0, with probabilities 
p and q respectively. The population distribution is thus 

fix, v) = J)*(l - 

I 

We have 


L = (]Sa;<) log p 21(1 - *«) log (1 — p) 

/^\ ^ ^ ^ ^ ^ m ftpo 

\dpA pB 1 - Po Pb( 1 - Pft) 

where m is the number of individuals belonging to A in the sample, Further- 
more 

- **[(1; - r^’] - - «»-■ 

96 per cent fiducial limits for po are got by solving the following equation for p^ 

V»Vw(i - Pd) 

It will be seen that situations, such as frequently occur in genetics, where p 
may be a function of some other parameter say p => can be handled by 
simply replooing po by u(6o) and oolving for 9o » 

^mplbS. Let the form of the distribution function be where 
0 < jp '< <30 , For a sample of individuals, 

L *5= n log ^ — JZiti 



J 
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The 96 per cent Mueiel liniits ( and 9 ore given by solving the equations 



for^. Weget 

j ’ j 

where it is the mean of the sample. 
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TRANSFOSMATIONS OF THE PEARSON Tn>E HI DISTRIBUTION 

By a. C. Olshbk 
I. iNTROmrCTOBY 

TranefomsidonB of 1I:te noimiil curve have been used ss s basis for the tepio^ 
sentation of skew frequency distributions by Edgeworth, Kaptoyn, Von Uven, 
Bernstein, and others. Yorious studies have boon made of the distributions 
obtained by replacing each of a set of normally disteibuted variates by a lo^ 
rithmie function of the variates, Among the eeiKer investigators along this 
hue were Galton, and McAllister; later, works by Jorgensen, Fisher, Wioksell, 
Davies, and a more recent study by Pae>Tl9i>7uan, wen added, 

Bietz^ restated and treated, in a general fashion, tlio question as to the propeN 
ties of the distribulion of powers of a set of variates which ore known to be 
normally dbtributed. By a suitable ehoioe lor the oriipn of the normal curve, 
he obtained rnults which are applicable in answering questions which frequently 
arise in the applied field concerning the properties of families of interrelated 
dUtributions, one strain of which is known to be normolty distributed.' For 
example, in the family made up of the (hameteis, surface areas, volumes, etc. of 
some phyrical quantity, if it ^vere known that one set, the surface areas for 
instance, were distributed normally, then from his results m have the properties 
of tire distributions of any of the other sets. 

Likewise it has seemed of interest to investigate, in a similar fashion, the 
properties of the transformed Type III Pearson ^atribution. We shall treat 
both the power and logaritbmio transformationa. For instance, if we know 
that any one of the ihysical measurements, velo<dWi kinetic enei'gy, momentum, 
or centrifugal force (all of which are functions of the velorily) were distributed 
according to a Typo HI curve, then we raise the question as to the properties 
of the distributions of any of the others. Similarly, if the intensity of certain 
light, I, were known to be distributod aixiording to a l^pe HI law, we will 
discuss the properti^ of the distribution of the brightness, B, of the light as 
seen by the eye, sinoo the two ore known to be related by the law B a £ log I, 
The same analysis applies to the relationship between L, the loudness of a 
sound, and E, the energy in the sound wave, rinee L a log S, 

Two fomns of the Type III distributimi will be considered. In the first form, 
all tile variates are taken positive; in the second form, the origin is at the mean 
and the variates are measured in units of standard deviation. 


^ H. L. Bleti, yreqner-oy DistributlonB Obtained By Cort^ Traostomuitloiu ef Nor- 
mally IMstributed Vuiatos, Annolg of Math., Vol, SB, (19S2) pp. 2D1-300. 
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In the last section, a traiieformatiou is developed which will tranafotm tlic 

ordinates of a given probability function into the ordinates of the noimal curve, 

‘ ' 

y s Ce ‘ , to within certain approximationa. This tranaformation ia applied 

to the Type III distribution and to the distribution obtained under power 
tranafonnations of vaiiates of the Typo III distribution, 

II. Fowsn Trawbfobmations 

a. Type III curve with dll variates positive. 

Given the Pearson Type III law, 

r 

(1) y = 0 ^ x < ®, 

where 

(2) 7 “ ~ ^ I/O — i ® — Ml ^ j ®iiip. — S . 

Ml rt7®) 7 7 

The probability function (1) ia a single-valued, real-valued, uon-negativo, 

400 

continuous function of x with / ydx^h The probability that a variate 
chosen at random will fall into the interval tvi to 02 is given by 



Let us moke a transformation by replacing eacli variate x by x\ where x* = ic”, 
and n is a real number on which restrictions will be placed as we proceed. When 
n is such that x* may have more than one value corresponding to an assigned 
value of X wc shall conader only the principal value of in', Then is! ^ nas*"”' d®, 

is! 

except at IP =a 0 when w < 1, and dx = — except at a?' = 0 when n> or 

m* ^ 

n <0. 

The frequency function of the x* variates is given by 
(4) 

n 

which does not represent a Type III curve when » 5 ^ L The function (4) is 

discontinuous at a;^ = 0 if ~ < 1. Likewise, corresponding to (3) we have 

n 

(6) P = ^ 

Til 


* The expression xtiko, ropresonte the mode, and represents the median. 
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( 6 ) 


In order to study the maama and nunima points of (4) we take the derivative 

-I ~7a/* -hyS- 


da' 


The derivative ehanges eigne at 
(7) a' 


(-;)■ 


ThuB, variates in an interval, dxfj at the mode of the new diatributioa (4) come 

by transfonnation, from an interval in the neighborhood of ^ ^ which is 

to the left of the mode of (1) when n > 1* The funotion (4) will be a monotone 
decreasing or a unimodal oontlnuous distribution with mode given by (7) 

aoaording as £ is equal to or is greater than ^ . 

It will prove oonvenient to discuss tha properties of (4) under three headings, 
aQOoidingasft > 1,0 <n< 1, and n<0, where or its reciprocal is an integer. 
Ousel, n > 1. ' 

M 

When £ < (4) is a monotone decreasiiig function, infinite at the origin and 

asymptotic to the axis; in this case the distribution of a/ ie eimilai to the 
distribution ariring in the oonrespondbg transformation of a set of normally 
distributed^ variates, when ie ^ 4(n - 1), where a is the withjnetic mean of the 
x'n of the normal curve. However, we are primarily intereated in the case 

when under which oondltilon a node exists on the frequenoy ourve /(«') 

y 

and is given by , Henoefoith in dJsousslng the comparative 

values of the measures of oentr^ tendenoy, it will be assumed that the condition 

2 > is satisfied. We have. 

T 

Thus, while variates at the modal value of % in the Type 111 distribution trans- 
form into p the mode of the new distribution is at - 2^ 

wfalch, when n > 1, is to the left of the podtibne to whioh variatee at the mode 
. of the III distribution were teonaformed. Furtheimoroi as n inoreeses, 
vLv, approaches the origin. 


* Of. Riets, loe. oit. p, 286. 
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m 


The aritbmeiio mean of the dietiibuted in acoord Tvith the fiinotion (4) is 
^ven by 


( 8 ) 


- 2! r dsr' 

ft Jo 

r(7^ w-) 


7'*r(7£) 

Similarly the etb moment about the origin is 

r(7J + fitt) (7^0 + en — 1)^"* 


( 0 ) 

But, 




7*"r(72) 


j«n 




wMoh i& greater than {i&y, hence 7hus, while variates at the mean 

Vly^ 4. 

value of in (1) transfom into {fty, the mean of (4) is at wlnoh is to 

the bright of the portions to which variates at the mean of (1) were transfoimed. 
We have 


( 10 ) 

hence 

(11) 


(-;)' 


< W < 


T(yA + n) 




In 1896, Karl Pearson^ showed that the median of the l^ein curve was 
approximately two-thirds of the distance from the mode to the mean, and later 
Doodson^ gave rimilar results. The analysis of (1) along this line is given in 

Section IV* However, since we may take Sns, = ® — — where 

y' 07 


d > 1, (approximately equal to 3). Then . 

(la 

hence from (10) 

(13) 


We have 




* Earl Fearsoa, Skew Variation in Eomoganeous Material, Philoaophloal TransaotioiiB, 
Vol. XSeA, part 1. (1805) pp. 848^14. 

* Arthur T. Doodson, Edatlon of Mode, Median and Mean in Frequenoy Curves, Bio- 
meirlka, Vol. 11, (1017) p. 425. 
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ConBidcring the cob© when n ^ 2 , we have with the aid of (9), 

+ 177« + 16)* 

~ (7i!)(7® + 1)(M + 3)*’ 
and 

3(V«* + + 337-r“s* + 02 Oy5 + 420) 

** (7*)(r* + l)(WsT^3)* 


From the moments of ( 1 )» one readily gets 


and 


— ^( 7 ^ 4" 2) 


It can be shown easily that z>Pi > and ; hence the distribution of 

the squares of variates is more leptokurtic and more skew than the original 
distribution* 

Fim (to) and (12) it is evident that the mode approaches neither the median 
nor the mean as n inci^eoscs, subject to the condition > n. Each of the 
ratios of the mode to the median and to the mean approaches tlie lirait I os £ is 
inercasod indefinitely, the xaindity of approach to the limiting value depending 
on the sise of n. 

Taking the second derivative to find the paints of infloction of the function 
(4), we have 



When the points of inflection eTost they are given by 


(14) 


, (27^8 — 3 n + 1 ) 6 n + 1 47^ 

2 y 


Under the restriction that yS^ ^ n, the eicprcssion under the radical in (14) 
cannot vanish, and will always be poutive. 

CaselL 0 < » < 1 . 

We now consider the distribution obtained by taking poaitivo integral roots 
of a set of variates distributed in accord with (1). The mode of f{x^, os given by 


(7), will always exist since from ( 2 ), 7 ^! > 1 > ?i. 

We have 

1 

A 

.-iY 

if n > V 

{ \ y/ \ 

cy/ 

c 

(i« (*-?)'>(' 


ifn<- 

c 

/'•-sY-.Y 

*-iY 

if ft 53 - 
c 

V y)".\ 

ey) 
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Hence it is evident that is less thanj greater tiian, or equal to x!nA» according 
nn n is greater than, less than, or equal to l/c. In power tmDsformations of 
B;yinmGtiical dlstributious^ the results differ in that the modal vedue is always 
greater or less than the median according as the value of n lies between 0 and 1 
or outside of these bounds. 

Here, j hence in contrast to Case I, the mode of the new 

distribution is to the right of the position to which variates at the mode of the 
Typo III difltribiitioii were transformed. 

It has been slmwn^ for evciY set of positive values that > (®)’* when n lies 
outside of the interval 0 to 1, and that < (£}" when n lies between 0 and 1. 
We have then 


(16) 


r( 7 g + n) 
(7)»r(7«) 


w'AtJ ztin < (5)". 


The mean of the new distribution is to the left of the position to which the 
variates at the mean of the Type III distribution were transformed. 

In Soction IV, with the aid of cerfcmn approximating assumptions, it will be 
shown that > xLi. when jc^d. > and conversely, < a4d. when aid. < aio. 
Case IIL n < 0. 

Let n ^ —m, wbem fn is a positive integer. Then we have 
(17) /(sO = - /(s') = 0 at ** * 0. 

Wt 

b 

In place of (6) we have 


and (7) becomes 



* H. L. Hietz, On Gortatn Froportioa of Proquoncy Diatributioas, Froc. National Acad- 
emy of Science, Vol. 18, (1087) p. 820. 

’ J. L. Wt y* Jenacn, On Convex Functions and tbe Inequolitioe between the Means, 
Aota Matheznatica, Vol. 30, pp. 175-1Q3. 
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Ee&cOj as in Case I, the mode of (17) is to the left of the position to whiah 
v^at^ at the mode of ( 1 ) wem iranrformod vrhile the mean of (17) is to the 
right of the position to which the variates at the mean of ( 1 ) were tronaformed. 
Since 



we have < 


/ 


Also 





henoB S' > aidr • Therefore 


( 20 ) 


SiDOf ^ ^ ® » 


As a special case, when n — 1 , (17) redueea to 

(21) /(#0 


whioh 3a a Pearcon Type V distribution* 
b. Tffpe 111 mm wUh m$<m zero and unit variance. 

Even though the form of the Type III distribution with which wc have been 
dealing, wberdn all « the variates are positive, is more closely akin to actual 
diairlbutions that may ariac in applied problems, nevcTthelesa it will be of intent 
to examine the properties of ttw transforined curve when the mean is taken as 
zero, with unit variance. 

The second and third moments about the mean of tlie distribution ( 1 ) are 
^ we write 03 for the third standard moment then 


( 22 ) 




By replacing the variable, in ( 1 ) by the expression 
(33) « = 


WC obtain the Typo III distribution 
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Equation (22) lends itself to a aimpb interpretation of the restriction mode in 
Section Ila, CJaae I, that-yj > nin order that the mode of (4) exist and be given 
by (7). The upper bound in the values of as considered by Salvosa* in the 
computation of his tables was oa «= 1*1. Upon examination of the tables it is 
obvious that in most oases the skewness of the Type III distribution, as measured 
by 03 , will be less than 1.1, Hence in most cases we will have 8.22 < < <» . 

The effect of the limitations imposed by the condition may be inleired to 
some extent from the following table, 


TABLE I 

The upper lomd of ot$ for Hie existence of a mode in Cose I, Section Ila 


2 

1 

3 

4 

1 5 

1 

0 

7 

8 

0 

10 

25 

60 

1.41 

1.16 

1.00 

1 .80 

.82 

i .76 

.71 

.67 

.63 

— r, 

.40 

.28 


When wo make a tTansformatlon by replacing each variate i in (24) by ( 
where i' =« t" (« 5^ 0) and n is an integer (positive or negative) or the reciprocal 

of an mteger, then dt' =» nt*"“^df/exceptatt =: Owbenn < Londdt s= ex* 

ni^ 

oept at » 0 when n > 1, or n < 0, The function (24) becomes 



The distribution function, is mfinito at » 0 when n > 1. In place of 
(6), we have 



Here oi and Oa ore taken to be positive or zero when n is even. When n is odd Oi 
and os may be taken negative oa (25) will give the frequency curve for negative 
values of t that arise from setting f ^ when t is negaMve. Examining for 
maxima and minima points, we have 

(27) ^ - -m f ^ + (n - d}- 


* LuU R. Salvosa, Tables of Pearson's Typo III Funation, AanoU of MathematioAl 
Ststletios, Yol. 1, (IC^) pp, 19MCBt 
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Thu derivativo changes signs at 


when j > Un - 1), and at A' «* 0 for cortain values of n. When « > 1, 

> 4(n - 1) only for very large vtduos of n since og < 2. When n is odd 

and poHitivei the derivative changes signs at f =s» 0. If n is the I'eciprocal of ati 
odd positive integer greater than one, ihero is a nxhnnniia at V ^ 0, and the 
function fQf) is zeiti at tlik point. Ihrther pmportics of the frequency curves 
given hy (25) will he discussed under the three cases treated in Section Ila. 

Cm I. n > 1. 



When 


(?)■ 


> 4(n — 1), it oan be ahown that (28) gives neither a maximuD) 


nor minimum ppint of /(I') ^ce wll olvrays be less than it .* BimiUily, 


when 


(?)' 


< 4(» “■ 1), there is neither a Maximum nor inimmum since (28) 


18 imaginary. Wlicn n fa odd, fii^) fa infinito at the origin and ia a monotone 
increasing function of t* from the lower bound to the ori^, and a monotone 
decreasing function of (f from the origin. When n fa even, f{t*) fa a monotone 
decreasing functiou of Infinite at the origin. The forma of the distributions 
in this Case arc ^milar to those in power transformations of norxnatiy 
distribiited variates^ when n>l and S® < 4(n - 1) and also to the forms arising 


% 

in Section Ila, Coao 1, when 5 < - . 

y 

ISvcn tliough we have a dfaeoxiiinuity at tho origin, the total area under the 
curve is one, which fa evident since wc can integrate function (26) over tho entire 
Tango of if when n fa odd and pomtivo. 

CmIL 0<n<l. 

Tbfa qa.^ includes tho distribution obtained by taking positive integral roots 
of a act of variates. As in the study of the normal diatribution,^* ^vc limit our 
considerations to the principal real Viduea of the functions. Wlicn n fa odd, there 
fa a minimum at i' « 0 and a maximum given by each of tlm two aigna befom 
the radical in (28), Hence in this caac, wc liave one minimum and two maxima. 

Witti the valucfi for n and «» in (24), imd. » --.164 and «= -.600, The 
transformed distribution gives G. * •^.647 and two modes, tho primary mode 
tpxo, « —.967, and the sccondaiy mode Co, « -OOS. In contrast to fee cor- 
responding transformation of normally distributed variates, the primary mode 
fa leas than the median. 


^ Tho oxpresBioh ropremts tho Lower bound of I in. distribution (24). 
^9 H. h, ^eUj Of. loe. cit. p. 295. 

Of. Efats, loCi olt« p. 287, 
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TABLE H 


Comparison oj the Type III Distribution and iAe Transformed DislrihiUion when 

€t^ ^ Mi n js S 


i 

n 

1' 

An 

-3.00 

.000001 

-27.000000 

0 

-2.60 

.001347 

-16.625000 

.000072 

-2.00 

.020467 

- 8.000000 

.002456 

-1.76 

.072787 

- 6.350376 

.007022 

-1.60 

.139286 

' - 3.376000 

.020636 

-1.26 

.220462 

1 - 1.063126 

.047032 

-1.00 

.301360 

1 - 1.000000 

.100460 

- .50 

.406345 

- .125000 

.640460 

- .26 

.414211 

- .016026 

2.209126 

- .10 

.406131 

- .001000 

13.637700 

- .05 

.401486 

- .000126 

53.631333 

- .02 

.308272 

- .000008 

331.803333 

0 

.306062 

0 

OO 

.02 

.303522 1 

.000008 1 

327.935000 

.06 

.380628 

.000126 

61.060400 

.10 

.382549 

.001000 

12.761633 

.16 

.374796 

.003376 

5.652610 

.26 

.367633 

.016625 

1.006843 

.50 

.307203 

. 125000 

.409724 

.75 

, .262071 

.421876 

.149000 

1.00 

.200403 

1.000000 

.066831 

1.60 

. .114233 

3.376000 

.016023 

2.00 

.058376 

8.000000 

.004866 

2.60 

.027286 

15.626000 

.001466 ' 

3.00 

.011836 

27.000000 

.000438 

3.60 

.004820 

42.875000 

.000131 

4.00 

.001869 

64.000000 

.000030 

6.00 

.000242 

126.000000 

.000003 

6.00 

.000027 

216.000000 

0 


CasellL n < 0. 

Let n = where m is a positive integer. Then (25) beoomes 




(29) 
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TABLE III 

Cowparisoti of the Tyjic III DistHbution onti the TTansfonaed Diulribulim WIm 

03 a J, n » I/ii 


- — ^ — ■ ' ■ 

1 

1 1 


fin 

-2.00 

0 

-1.250921 

0 

-1.76 

.026272 

-1.206071 

.11010 

-1.60 

,122026 

-1.144714 

.48206 

-1.26 

.261021 

-1.077217 

.87386 

-1.00 

.360894 

-1.000000 

1,08268 

- ,00 ■ 

..393277 

- .966480 

1.00008 

- .76 

.427626' 

- .908560 

1.05874 

- .60 

.448084 

- .703701 

.84683 

- .27 

, .433968 

- .646330 

.64386 

- ,08 

1 .406678 

~ .430887 

.22600 

0 

1 .300734 

0 

0 

.08 

.374^6 

.430887 

.20861 

.27 

.332027 

.646330 

.41723 

.50 

.280748 

.793701 

.53058 

.64 

.240865 ^ 

.861774 

.55660 

.74 

.228711 

.904604 

.56134 

.00 

.106004 

.066480 

.65064 

1,00 

-.178470 

1.000000 

.63641 

1,60 

,104250 

1.144714 

.40085 

2,00 

,067262 

1.260921 

.27236 

2.60 

.029080 

1.367209 1 

. 16572 

3,00 

.016133 

1,442250 1 

.00443 

3.60 

.007410 

1.618205 

.06126 

4,00 

,003639 

1.687401 

.02676 

4.60 

.001656 

1.050064 

.01363 

5.00 

.000701 

1.700976 

.00368 

6.60 

.000344 

1 .705174 

.00322 


Taking the dcrivatave, 

(30) ^ f - 1 }, 


and in plfUiC of (28) we have 


(31) 


t’m< 



2(»i + ]) 


The tt&nBformed distribution iittla statistical significatico for odd values 
of m, wncQ f{i*) is a disjoined distribution, There are no values for /«') in the 
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interval* 



<e 


< 0, since — ^ i < « 

Cll 


The ti-ansfarmcd distribution is 


thus composod of two s(‘«tioa&, each with its own mode. Tlw iH*ctioii for negative 


values of i\ with range - » < t 




has a mode given by (31) with the 


negative sign before the radieah The section for positive vahies of with range 
0 < f has a mode given by (31) with the positive sign before the radical. 

When m is an oven integer, if we assign to f{V) the value 0 when t' « 0, f{i*) 
becomes a continuous unimoda! distribution in tho interval 0 ^ with 

tho mode given by (31)j with the positive sign before the rmlical. 


111. LoQABlTKMIcl'nANBFOXlMATlONS ■ 

As indicated in tho intraductiou, numerous studies have been made of the 
distributions obtained by roplachig normally distributed variates by exponential 
functions of tho variates. If a varinto with range - w < a? <«, is dis- 
tributed noimalty with mvan scro and unit variance, then by replacing z by s', 
whoro s' = c + tho range of s' becomes, c < s' < Likewise if a variate x 
is distributod in accord with a Type III law, with range 0 ^ s < « , then in 
making the above transformation, the range of s' becomes (c + 1) ^ it;' < 

Wc shall now study tlie properties of the distributioji of x' obtained by tho 
above traupformation applied to distribution (1)* Because of the similarity of 
the properties of tho transformed frequency ^stributions, we shall take k ^ I 
and c ® 0. 

Twitting ss (1) is ti'ausformed into 

(32) /(sO « y. (log 

Then, 

(38) - /(a0(x' log *'r‘i(7iE - 1) - (7 + 0 log *'1 • 

The derivative changes signs at 

(34) = 

Tlie arithmetic mean of the x"b diatributed in accord with (32) ia ^ven by 

(36) “(^y* 


1 
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The integral is divergent when 0 < 7 ^ henoo for these oases we take 
0 < Jb < % then ^ 


(36) 



likewise in order that the first s momenta about the origin be finite when 
0 < 7 < s, we must have 0 < fc < 

a 

The median of the diatribution of a;^'a correapouds to 


hence 

(37) 


X c= log 


0 


1 



, ± 
iCwul. «*s 


1 


Xti I L 

1. The relative positlona of the averages. We have < a since 


■Y + 1 ey 


(38) 

^xno* V %a<l4 ' 

A]bo, 




Therefoto 


and hence 


(89) 


From (38) and (39), we have 
(40) 



yt 


We shall now investigate the locations of the various averages as related to 
the upper and lower points of inflection whose abaoiaaos will be denoted by /u 
and /i reapeetivoly. Taking the second derivative, 

ft- /(^O W log KyS - l)( 7 i& - 2 ) - ( 27 “® + 3r^’ - 27 - 3) log®' 


+ (y + l)(^ ^ 
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The points of inflection aro given by 

t 

(41) i' « 

where 

/ «\ _ M - 1)(2t + 3) ±V'(Y!t - - 1) + + i)(Y+^ 

<p{y, i) 2(7 + 1 )(t + 2 ) 

(a). To show a;!,, > 7j . 

We have, 

(7^-1)(2t + 3)^(t^--1)(p + 1) 

7 + 1 2(r+l)(Y + 2) ' 

where 

p + l » 8 lnce 27 + 4>27 + 2-p. 

Therefore 

TJ-1 

eTiT > 


(b) . To show < /L • 

We have, 

7g-l . (7g - 1)(27 + 3) + (7g - l)(p + 1) 
7 + 1 2(7 + 1)(7 + 2) 

isince 2 y + 4<27 + 4 + p. 

Therefore, 

From (a) and (b), we have 

(42) 1 1 <! ^ 9 , < Ju* 

(c) . To show xLd. > I \ . 

We have, 

^ a ^nn . find ^nfl i ^ 7j 1 

Consequently 

f . 7/ 


(d). To show the conditions under which ici»d. than or greater than 7i . 
Upon simplifying the inequality we find that will be greater or less 

than according os the expression 


(43) +^) + (7 - 3)| + ^-(2 + ?) - i (3 + 1) - 2 I 
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is positive or negAtivc. But (^) will be negative for oil values of £ if Its dis- 
criminant is negative or iscro. Upon further examination it can be seen that the 
diRcriminaat will be negative or ssoro accoi'ding as 


(44) + 

The quadratic equation in y, given by (44), fncboi's into 

whero 

B-y^36(l-.lJ^!(6 + 0 + 38, B > A, 
Hence in oixler that bo. gn'^ator than 4 for oil values of wc must hove 



When c lies in the neighborhood of 3 , 7 must be loss than 5. Proceeding further, 
we can divide (43) by negative 2, iieverec the iuequalitica, and factor the expres- 
sion into 



4 




where 

13' <A\- 


Then 

(46) awd. > K if 
and 

(48) ’ 4i, < /'» 

(e). To show l[ < y. 



or 


iS> 


A' + B’ 
4 ' 


if 


A< ~B' . ^ A' + 

— < 4 ‘ < — . 

4 4 


4 
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Wo have, ![ < since > iCra<i. > and acrto. > J/ . Also, ^ for 
thoae values of y and 5 for which Jr < a4u. . It reniams to be shown that is 
always gimter than /I. for all values of y and To show that 


It will be auffioient to show that tpu{y, jJ) < since 


The inequality is satisfied if 


(7« - 1) I {y^ - 1) + 4(r + 1 ){t + 2) } < m(y + 1)(7 + 2) « {y^ - 1) (2r + 3 ) ]\ 
This expression, howe^»eT, reduces to the condition that we must have 

-2 - 7* - 6* - - 7*« - < 0, 


which is always true. Hence 





and wo have 


(47) 




2. Contact at the ends of the range» Wo shall now inveatigato whether the 
frequency function, /(s:'), has high contact with the x* axis. Tho function, 
/(x*), vanishes at both limits, and thus it will be sufficient to test tho derivatives. 
The nth derivative can be oxpreissed in the form of f(x*)(x' log multiplied 
by an nth degree polynomial in log xf. It can cosily be shown that each derivar 
tivG will vanish at the upper limit, while the .nth derivative will vanish at the 
lower limit provided ri? > n. Therefore, /(a;') docs not have high contact at the 
lower end of the range. 


3. Moments, The sth moment about tho origin is ^ven by 




r Gog ds' 


-yojT 

( 48 ) 

If V S s, ihon taking h such that y > sfc > 0, we get in place of (48), 
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We easily obtain the I'caurring i^lationahip 

/tn\ ' ' ' 

(60) « ( ■ yL "^"' ) 

The sth moment of / about the mean is 

«=» iftijf I®' - d»' 

'"I 

» -(Ar&-«'e)(*r(.-si5)' 

If we do nob take the value of h to be 1, then 

IV. TuAif^oRitf^TJoN 7mo A Nobmal Dte'nuBTTnoN 

We shall novp eondder a unimodcd probability function y /(jc) with range, 
a ^ i6 ^ bf and shall seek to express t$ as such a function of t as will transform 

y ^ /(*)i tato y tfs <7fl V, 5»or simplicity, we assume .that y cp /(») has its 

modal value at ai ^ 0, and thus eaoh of the curves y ^ f{0) and y » Ce^ basits 
one maximum value at the origin. 
l^y f(^) let log y » V, then equating densities/^ we have. 


Then 


r- log (7 + 5 - 0 . 


-3r + * = 0, 


(63) 


(tt* 


+ 1 =- 0 , 


dry 


n>3. 


If /(a) 1 b a probability function or density of a distribution, then J(3&) dx is, to within 
IndniteBAinslB of higber order, the probability that a value taken at random will fall into 
the Interval d# at x. 
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Un^r the asaumptioa that « is a funetioa whioh m be in a Maclaarin 

series in powers of i, wo shall use cquaUons (63) to detomune the values of 

- 3-1 in the senes 
W* Jim 


(64) 


X « Ao -4" A.\i Aa ni “t“ * * * 


^ y"l jw 

Let Sn represent ^]n»0|lj2>>>, Then V d* log C, and vi a 0, since ^ 

and vanish when it a Oj that is when 1 o 0, since ilg is taken to be scro. 
Taking the second derivative, 



dP d:P \dt/ dp \die J ^ ’ 

and 


Therefore we have 


(55) 

Ai o= when na < 0. 

Abo, 

^1-0 “ 

and we have 


(68) 

A i!. 

“ 8«^* 

Similarly, 



- la-i * 

(67) Ai ■= ’“(400* 46iiginS4 -f 94tti) 

* 46e} ’ 


Afi ss 


^ — {385^9 — 630ti9i^it)4 21 i4 (SvjVb -I* StiJ) — 24v|vt| (— 

144 »} 


Though the procedure is ' straiglitforwarch the work becomes somewhat 
involved in deterraing A« ns n gets lai’gci*. For this reason, we proceed in the 
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following manner* By tha iifle of Burmann's^ theorem we can write (54) in 
the form 



whore 7 is a function of x> We have, 

'"‘“-’'L' S'" •* 


and we miswrite 


7-Joga+ <wj,-i)3l'*' 


Hence, 


^ »* ((*»»* + Ojjr* + + • * •) * 


» (fla + «»» + 04 ®* + • • •)"\ where a« ^ 


We ean nw write, 

n 

(B6) 


But 

• 

1 1 

e 

^|4 

H 

R 

= (n — 1)1 multiplied by the coefficient of in (69). 

Hence, 


^n ^ x,ix,rx,ix,i 


(s-f (a)" (*)"... 

\(h/ \a»/ \os/ \ fla / 


where the summation is over all values of \ such that 

^ A 

and 


A. De Morgan^ DUferentlal and Integral OalouluSf (1842) page 305. 
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This exprcB^on can be \\rrittcu in tl\c form, 


9 fl-^2 


(61) 


A. = (n-l)l(2a^"2(-ir‘” 

i<-D 2 4 


n + 2 71 + 4 


?t + 2fl 


2(« + 1) oj+i 

where D is the derivative operator of Avbogast.” 

If we take expression ( 1 ) b 3 our funotion of Xi wc obtain, 

\ 

1-1 (n — I) 1 7 " 


n > li 


(- 1 )' 


_ n*-!' 


{yi - 1) 


which gives 

(7* - 1) , ( y $ - D* . . 2 


X » 


+ 


(62) 


t . ^:.4. i_. 4 . _J_ 

^ 37 21 ^ 67(7* ” 1)‘ 81 467(7* - 1) 

. 1 t* 

3^(78 - i)l 51 “ 


where A» » (n — 1 ) I - muliaplied by the eoeffleient of ■ 

2*" 7* 

[-(-r ^ 

This aeries is known to diverge for large values of L However, tho seriea is 

defined for those values of i that correspond to x for the interval 0 < x < ^ 

With the aid of ( 22 ) and SaIvosa’s‘^ tables wq give in Table IV tlio percentoga of 
the total population which is ineiuded in this interval 


TABLE IV 

TA« psrcfltUops 0 / lAa popufatfon, cAaracl«r£ud (0* vthick U incluM in Uta itUsnal 
0 < X < 0(2 * i/y)t /or differtni degrees of ikewjuai 



LI 

1 

.0 

.8 

.7 

.8 i 

.5 1 

^1 

'.4 


.2 1 

.1 

Feroent of 
Population 

79.888 

84.880 

88.781 

■MM 

■ 


inn.uoo 

■ 

■ 


Thus, in dealing with samples as large as 10,000, with moderate degrees of 
skewness, the probability of getting a value that falls beyond this interval 


Augustus Dc Morgan, On Arbogost^fi Formulae of Expansiuni (Jiimbrldge and DubHn 
Mathematloal Journal, Vol, 1, (1848) pp. 238-^, 

Cf. Salvoso, loo. oit. page 2. ' 
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becomes negllpble, Hence H may be e:«pcctcd that Twith the use of a comparar 
tively few toms of series (62) we may transfarm the ordmates of a moderately 
skew Type III function to within close approximations of the ordinates of the 
normal function. 

Baker'^ considered the transformations of a non-nonnal fh^quency distribution 
represented by where the origin is taken at some c^txal point end the 
acale is the standard deviation, of the distribution. By equalwg probabilities 
he found a function such that by setting i ^ «>(u)j he obtained 

/[i^(u)l. du te €'**** du. 

It seemed of interest to compare the results obtained by applying transfonnation 
(62}) wbioh is found by equating densities) to the illustration treated by 
Bak^ ” where the transfonnation giving equality of probabilities was used. 
The example treated was 

(63) /(i) =.9929^1 

This is a Type 111 distribution of form (24)) with og ,2, From (22), 
4 

a ^ la 100, and from (02) we obtain the series 

I 

(64) * * ^ (1 + .lOOeoaStt + .OOSaeTOu’ + .0000282u* - .ooooooW + . ■ ■). 

If 

We Bhail utiHse only the first four terms and rewrite (64) in the form 
-y* « 99(1 + .1006038tt + .OOSMOtt’ + .00002g2u*). 

Howeveri from (SS), 

whieh^Yes 

yx <• 7>j(l "i" 

Therefore, 

i = .1(7* ~ 100), 


“ G. A. Biksr, THmsforjnation of NoB-normal Proquanoy DUtribuUoM iato Normal 
DistributldCBj Annals of Mathematioal StatletioSi Vol. S, (1934) pp. Il3-*123. 

Baker, Iqo, oit. page 117, ' 
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With tho aid of Solvosa's^ tables, we obtain the following roeults. • 

TABLE V 


Comparison of the ordinates of the normal function^ the function mih skewnessnUt 

and the skmed function iroTi^ormed 

t = 9,9 i-miOlO +J00S0S8U +,0(^870 u^ +.oooomu^) 


u 

Normal Curvo 

Funotion with 
akewnesB .2 

Transformsd 
skow aurvo 

Transformed 
skew aUEve 
minus Jiormfi] 

-2.0 

.053091 

.049243 

.054226 

.000236 

-1.8 

.078050 

.076810 

.070201 

.000341 

-1.6 

.110921 

.112956 

.111303 

.000472 

-1.4 

.149727 

.157043 

.160350 

.000032 

-1.2 

1 .194186 

.206961 

- .106003 

.000617 

-1.0 

.241971 

.260120 

.242086 

.001016 

- .8 

.289692 

.308968 

.290005 

.001213 

- .0 

.333225 

.351538 

,334618 

.001893 

- .4 

.368270 

.882463 

.369811 

.001641 

- .2 

.391043 

.398683 

.302678 . 

.001635 

0 

.398942 

.398610 

.400613 

.001673 

.2 

.391043 

.383167 

,302682 

.001639 

.4 

.368270 

.364646 

.369811 

.001641 

.6 

.333226 

.316273 

.334621 

.001396 

.8 

.289692 

,272360 

.200005 

.001213 

1.0 

.241971 

.m71i 

.242084 

.001013 

1.2 

.194186 

.182641 

.194090 

.000823 

1.4 

.149727 

.142663 

.150363 

.000026 

1.6 

.110921 

.107930 

,111383 

.000462 

1.8 

,078960 

.079364 

,079277 

.000327 

2.0 

.063091 

.066702 

.054214 

.000223 


The ordinates of the transformed distribution arc more aymmctrical and 
approximate the ordinates of the normal cunre more closely than the values 
obtained by Baker even though we have used only four terms in the transforming 
series. 

Befcurning to the general case, we may write 



Salvosa, loo, oit, pp. 64 efcseq. 
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provided the series converges for all values of L Under tho assumption that the 
integrand satisfies conditions for the term b^r term integration of the scries, 
we got 

(®0) ^ VSrj^i + ^ ^ + • ' • + + • • *1' 

The area to the right of the modal ordinate is 


= i + C 






(67) 


A* 


h + cUt + ~ + 


• ■ 


)di 


Hence tho area from tho mode to the median is 

(08) (7^A, + y^+ ...| 

Let US consider efistribution (1) again. The coefficients in series (82) arc 
functions of the skewness, and become smaller with smaller degrees of skewness. 
Indications are that with moderate skewness, the series converges sufficientiy 
to be used for certain formal purposes* If wo assume this and proceed in a 
formal manner we obtain some interesting results that are consistent with 
approximations that have been obtained elsewhere, 

Thus, it is interesting to note that using the coefficients of series (62) in equa 
tion (66), wo obtain 

r(7it) « V2ir(7* - 1) (7* - 

12(7* - 1) 288{7fi - 1)* ■ ’ r 

which 18 Stirling's asymptotic form for T(y£)^^ 

From (68), the area from the mode to the median in the Tj^e III distribution 
characterized by (1) is approximately 

' Ksy “ 1367('>'* - 1) 

where 

^ _ 7(73 - l)^*-‘e-‘^" 

■ 


’* K* Csuber, WahraoheJnliohkoitaroolmung, Volunio 1, (1D08) pp. 23-24, 
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Since ( 71 ! - 1) is large when the skowneas is moderate, and since the terms of (69) 
oro rapidly deemaaing, the area from the mode to the median is approximatoty 
2C 1 

equal to But - is the diataiico from the mode to tlic mean and C is Uie 

ordinate at the mode, hence the area from the mode to the median is approxi- 
mately equal to the ordinate at the mode multiplied by 2/3 of the distance 
between the mode and mean. Therefore with moderate skewness the median is 
approximately 2/3 of the distance between the mode and mean, which conforms 
to the approximate result first obtained by Karl Pcaraon®” for the Type III 
distribution. We may, for all cases resulting in ( 68 ), take dj fls being approxi- 
mately equal to the distance from the mode to tho median* This becomes 
somewhat more apparent by finding the arithmetic mean of distribution y. 
Thus, 


.1 

■■f 


£-( 


wl* + + ^|- + -4* 


31^ / 


xy<h 

f 

Hdx 


( 


Ai + il»t + 


21 


'31 


di 


C V 2 ir^vli + ^ + ^- H ^ 


A A fAt/. 


Ai . SAiAa , BAtA 


^ 41 ^ 


■2r3r;+'” 


j 4 , J-d* 4 . 4 . 

‘^21 ^ 41 ^ 


(70) 




Rememboring that Aq is the abscissa of the mode, it becomes apparent that the 
moan is, in genoral, approximately equal to the mode plus 3/^ of the distance 
from the mode to the mcdtM. 

. Though scries (62) is known not to converge for large vaKiPa of i, it is interest- 
ing to note that if we use distribution ( 1 ) for y, m have from (70) 

(71) «'■ - (* - ^) + Kl;) ■ 3,w - wi + • ■ • • 


the first two terms of which give which is fil , and hence if (71) were an exact 
formula, tho sum of tlie tiirros beyond the second would be aero. 

For example (63), it can be seen from the following tliat As furnished a close ap- 
proximation to the distance from the mode to tho median. Here, < » ,1 ^ 100 ) ^ 


putting X as ^ 


“ MT liave 

y 


.1(y» - 101) =5 -.1. Putting 


** Karl Pmsotii loo. cit. 
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Z » 



2 

jlq se ^ , we have as our approximation to the 
dy 


ntedian 



ss —,03823. 


InteTpokting in tho Stdvosa tables, we find for cm » .2, => .02331 approxi" 

niately. Henoe it is seen that the interpolated values cheeks veiy closely with 
that obtained by using the At criterion. 

We stiall new consider briefiy the transforming series, when for y, we take 
distribution (4). Then, corresponding to (54), we obtfun the aeries 

ftift a-' ^ i 4 ^ 

' ^ 7” t Sr 2\ 

, n(6n* - fin + - «)""* ^ 

67 * 3! 

, n(4Sn* - 90n* + 45ti - i}{yi - n)"'* , 

+ 

When » e 1, (72) reduces to tho aeries (pven by (02), Supi)psc wc ore primarily 
interested in the cases for which 0 < n < 1. For these cases the coefficients of 
(72) decrease more rapidly than do those of acrica (Q2). Under tho same 
assumptions as to convergence which were made in working with the latter 
series wo have, from (68) and (72), the area from tho mode to tho median given 
approximately by 

fl/n(8n - l)C 7 i! - n}*"‘ l w(d6»’ - fiOn* + 4Sn - 4)(72 - n)"^ ^ \ 

OS) (!| jj: + +.,j. 

When 0 < ji< 1 wc always have 7 ^ > n; then Aj > 0 if a > 1/3, and Aj < 0 
if n < 1/3. Therefore, It Ai is taken to bo approximately equal to the distance 
from the mode to the median, we have xU > iLi. if « < 1/3, and iiL. < aw. 
if n > 1/3, aince At is poeitivo or negative according as n ie greater or leas than 
1/3, Combining those results with (70), w'c have s' > ild. if iL. < lUmd. i and 
^ Xml. if iVno. ^ a^d. i wliicli siv tlip rclntioiis given in Section Ila, for case II. 



A iwr OF THE SIGNIFICANCE OF THE DIFFERENCE BETWEEN 
MEANS OP SAMPLES FROM TWO NORMAL POPULATIONS 
WITHOUT ASSUMING EQUAL VARIANCES' 

By Daisy M, Stabket 

1, History of the problem. If the only available evidence about two normally 
iKstributed populations is cout^ed in two samples, one from each, it has 
hitherto been tiie custom to the test tiie hypothesis that the means are cqu^ by 

. S ^ X ^ ^ 

assunung that the quantity is distributed in Student's distribution! 


V^+fc's'* 

with W + *- 2 degrees of freedom, where s' 


1 2(ji - z)' 


and h 


N{N - 1 ) 

I iri^ nJ I the other notation bong that used by R. A. Fitiier,’ The 
Jv (« + iv - 2; 

hypothesis underl;^ng tbb test, however, is that the variances are equal. Al* 
though in many coses this may seem a reasonable assumption to adopt concu^ 
rently with that of oqod means, it is undoubtedly not a necessary one, and it is, 
therefore, derirable that the test shonid be adapted to meet this difficulty. 

The first advance on the problem was made by W. V. Behrens’ who suggested 
that tiae dbtribution of the (Merence of the means could be expressed in terms 
the observations in the samples from the two populations, the argument 
being entirely independent of the varianees. 11. A. Fisher’ obtruned substan- 
tially the same result, but expressed the argument in terms of fiducial probability. 
M. S. Bartlett’ was of the opinion that Behrens' reasoning was incorrect, as he 
obtained some results which were appaimitly inconsisUmt with those tabulated 
in Behrens' paper, but R. A. ^her' showed that Bartlett's argument 
was open to critieism. In the latter work, be actually obt^ed distributions 
for the case of two samples of two obsorvatious, and in tlie follomng we shall 
indicate some extensions of this more detailed work of Fisher, firstly, to the case 


I Presented at the joint meeting of the American hlothematical Society and the Insti- 
tute of Mathefmatical Statutios, Indiauniwlis, December 30, 1837. 

Research done under a grant-in-aid from the Carnegie Corporation of New Vorh (Sty, 

) dtotistieof Methodi for Emarck Workm, 1826-1030. 

* "Ein Beitrag sur Fchlorberechnuui bei wenige Bcoboohtiuigcn," Lmdiv. Jb, 68, 807-37 
(1026). 

* "Tike Fidnaiol Argument in Statietical Inferanac," Annab of Eugonua, 0 (1036) 
pp. 301-8. 

' "The Information Available in Small Samples," Proc. Comb. Phil, See, 32, pp. 660-6 
(1036). 

' "On a Point Raieed by M. 8. Bartlett on Piduoial Probability,'’ Annob of Eugetties 7 • 
Port IV, 370-6 (1037). 
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o{ othet Bmall samples of even numbets of observationa, end, secondly, to samples 
of very large numbers. 


2. The case of small samples. Wo reoapitulatej brioftyj the preliminary 
.argument of R, A, Fisher^ in which he denotes the unknown population means 

by jt Bad m'- Since ~ — - t, where t is distributed in Student's distribution, 

we may write m ^ obtain the fithudol distribution of the population 

parameter ^ in the form Oiijn) where 



and a similar result for the fiducial distribution of n'* The aimultanoous fiducud 
distribution of ft and p' is thus OM from which the fiducial distri- 

bution ot ft - fi' may be found. We may note that the characteristic function 
of ^ (ja - /) + (* - iS') IB Af {«), where 

fljWGiG*') dn dn' 

where 



with a idmilar expression for Hs(0< Thus from the fiducial poipt of view, the 
problem ie essentially that of formally determining the dietributioii of the 
variate ia - fV, or at + where a » s, b » - are regarded as constants, t 
and being distributed in ''Student's'^ distribution. The hypothesis m ^ m' 
may then be examined by testing whether if - :SMa a significantly large value of 
this variate. We dnell approach this distribution problem through the use of 
characteristic functions. 

By definition, the oharacteristlo function of ''Student's’’ distribution is 
represented by the integral 


0 ) 


1 r[Mn + 1)] r 

r(jB) j-i» / j 


and may be evaluated by three methods urhioh will be briefly considered. 



T&BT of DIFFSEBNCEl BBTWISEI^ MEANS 


203 


I 

Firat^ by intGgra.ting the futieiion 

1 r[i(» + 1)] e**'*’ 

^/^ r(4n) ^ 



aground a standard asmiciroular contour in the upper luilf of the ^piane» the 
value of the charact^ietic function is at once proved to be 2^^ iiicee the sum 
of the residues of the integrand vrithin the contour when the radius of the semi- 
circle becomes infinite. Within the contour there is one pole only at s ^ iv/n* 
The residuo at this pole la the coe^oient of Ifh in the expansion of 


1 

V^Trti 


T[i(n + 1)] 

r(in) 




[(« 


&■ + 


n-t-l 

A'^'F 

Vi/J 


in ascending powers of hj which may readily be evaluated when n is odd. 
Second, by using the result that 




from which we deduce that 


1 

tr 





Difierentiating this result (n — 1} times with respect to a, again, considering odd 
values of n, we have that 



By forming the first order differential equation in y » i , and diff erentint- 

y/a 

ing it 3) times using Leibnits* theorem, we may obtain a linear mlatioii 
between the derivatives of order — 1) and lower; similarly, by difioreiitiating 
i(n — 6) times, we may obtain a linear relation between the derivatives of all 
o^ets up to and including -- 3), and continuing in this way, we obtain a set 
of i(n — 1) linear equations in the \(n — 1) unknown derivatives* These 
equations may be solved for the derivative of order K’' 1) by the detenninant 

rule. The denominator detenninant is inde^ndent of x, and the numerator is 
■ e”***'^ multiplied by a polynomial of degree ^(n — 1) in x. Using this fact, wc 
may specify undetermined values for the coefficients in this polynomial, and 
obtain relations between these values for two conseevitivc values of n by differ- 
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enlaating onoe. The recurrence rdaiionB thus obtained may be used to verify 
by matbematloBl induction the foUowing ration, after substituting a a 


( 2 ) 


1 m(n + 1)] 

^ r(4n) 







d( 


c-wv:ri 1 KIWI j.(l»lVn)'(n-3)_, (|*|v^)*(«-i5) 
e *Ll + l®IVn + — + — 


the ooeffident of (| s ( V^)’* being 

• JL fa - 4fe + l)(n - jib + 3)(n - 4fc + g) • . . (n- 2fc - 1) 
(2ib)l (n - 3)(n 4)(n - 6) • • • (n — 2i) 

and the ooeffioisnt of (| k | being 



1 (ft - 4)ii - l)fa - 4fc + 1). ■ .fa - 2fe - 8) 

(2fc + 1) ! (ti ” 2)(tt “ 4) • • * fa ~ 26) ” ’ 

This is, therefore, the value of the dkttraetenstio function, and is the some in 
form as tiie result which may be obtained by the first method. There an 
evidently a finite number id terms, the degree of the polynomial being i(n -> 1). 

Third, the cbaraoteristic function may be shown to satisfy the second order 
£&erential equation. 


By change of vanahles y » e~*'^ (we assume that a is potitive, as it may be 
replaced by its absolute value in the integral) end u » x Vn* we obtain 


Tlting the Frobeniua method cd solution in series, we obtain as one solution when 
n is odd the expression 


V 


ti* (ft — 5) I ft’ (ft — 5) 
21 (n - 2) 31 (ft - 2) 


+ 


* • t 


and the ooiresponding valua of y haa aboady hem pmad to be the value of the 
charaoteriiatio funotion. It is probable that the corresponding solution of the 
difierential qquation would also be the value of the oharactarisUc function when 
n is even. In this caae^ howeveTi the indidal equation has roots differing by an 
integeti and the solution of the difierentiel equation is much more complicated 
in form. NevertheleB&, it seeme possible to find a eeriee eKpansion for the 
characteristic function of '^StudentV’ distribution in this way whatever be the 
value of n. 

The characteristic functions of the dietributions of at and W may now be 
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readily obtained by replacing x by oe and bx in the above expression. Multi- 
plying tiie obaracteriatio lunotions of these two independent distributiona, we 
obtain the eharaoteristic function of the distribution of of -h bt', which is of the 
form 

Mix) = [1 + 1 X I (1 a ! Va + i M VI?) + • - • 1 , 


the term in brackets being a polynomial of degree' ^ , We 

iB 

use the result that the distribution is ^ven by the integral 


may now 


-f 

Htf J— < 


jl/(®) dx, 


and BO obtain the distribution of u == ol + hl\ 

A distribution so obtained 'would involve four constants, a, b, n and n', and a 
derived probability table would thus be vciy complicated. It raay, however, 
be simplified firstly by considering the case of equal sample numbers, and, 
secondly, making the transformation 


(3) 


V 


(at + 5t0 

a\ + \bV 


whence the resulting distribution involves only two constants, a, and the 
ratio a/6. In this case the form of the characteristic function is 

r _ . t» n, 


(4) 


.-1*1 vr 


l + \3i\Vn + 




21 




In deteimining the form of the distribution, wo shall encounter intcgralB of the 
form 


(«)*» r I” dx. 


This can be reduced to 


'f 




sr dx + 




da, 


and, integrating by parts, or using the Gamma EWetion integral, we obtain 
as the value of this integral 


\ 


[(Vtt + (V» - 

Writing V ^ Vn tan 6^ this reduces to 

2 cos (p + 1) cos’^' 0, 


]• 
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The distribution is thus aeon to be; — 

(6) - [j»o + PiC 08 29 + piOOsJcotSfl + ••• + p«r4 ooa""* cos uS] dfl, 

IT 

where 

I 

(a> + 6«)^ + 2|a6[ 

OalTT^l? 

It is obvious that the values of the coefficients p may all be expressed in terms 

of the ratio ? . Penoting this ratio by r, 

0 

+ 1) j — s + 2r 
(r + l)» ' 

and thus we could construot a table for the probidiility integral involving n, r and 
V only. 

The process of evaluating the probability integral may be simplified by con- 
sidering the term already evaluated, 

n*" ; X I' dx. 

Integrating this expression under the integral sign with respaot to v, between 
the limits v and oo, the contribution to the probability integr^ from this term is 
seen to be 

sj! r da, 

which on the introduction of the same transformation as before, gives the value 

— 2 (p — 1)1 oos^ 6 sin pd* 

Thus, from (6), the total probability that ^ should lie between ^ and a given 
value, iB 

(6) ij^I-fl-oosS8in9-^coB*9Biii2fl- - j^!=^c08""*981a(» - Dsl, 
where - ' S 9 ^ | . 

The following summaiiBes the results for amal} values of n, 

. - ot + 6t' 

n = l. = 


1. 
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The reaults reduce to those already given by Fisher. The distribution is then 
d& 

simply — , 01 Student’s distribution, and is independent of a and b, and the 

V 

1 0 

probability integral is ;= — . 

« fl* 


2. 


n "5 3. 


tan 6 


at + W 


Vl(|o| + |6|)' 


The dietribution function is 




1 + cos 2s + 


2r 


(1 4- r)‘ 


oos 9 cos 39 


]. 


and the probability integral 




3. 


cos 0 sin 0 ~ 
n = 6. tan 0 


oi -J- 

VB(|a| + li|)- 


ain 20 1. 


The dietribution function is 


» L 


1 + cos 20 + 1 cos 0 COB 30 


+ TT-T^. 008* 0 008 40 + 


(1 + T)* 

and the probability integral 

1 (r* + 1 + 8r) 9 . . 


3(1 + r)‘ 


cos’ 0 cos 60 


]• 




cos 0 ain 0 - = - TT - f- V/' - ooa’ 6 sin 20 
3 (1 + r)* 




3. Samples of large numbers. The foregoing method is not suitable when 
n and n' are large. In, this ease we use the asymptotio expansion of "Student’s” 
distribution which hae been worked out by R. A. Fisher^ and ie of the form, 




1 r[Kn + 1)1 dt 


r(in) 


(7) 


»l+l 

('•r 


roj 


J_ 8“*'’ 

vs; 


di 




’ "The Expansion of 'Student's' Distribution In Powers of rrV Dfstron, Vol, f, no. 3 
(less), pp, '22-25. 
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whore Pk is a polynomial of degree 4^ in /, such that 



A 


3t* - 28t® + 3(M* + 12(“ + 3 
06 


etc* 


TIic development of an asymptotic expansion for the distribution of at + bt* 
is obtained by combining tlio asymptotic expansions of t and f'. The. theoretical 
justification of the process used makes use of the following 
If Rtt{l) i9 the remainder after Oieftrst {h + 1) terms m the asymptotic expansion 

of **Studen(B*^ distribution in descending powers of n, then lim 1 = 0. 

B-rte Jo 

In the proof; the symbol will be used to denote the limit as n tends to 
infinity of the quantity in question. Let 5jb(0 represent the sum of the first 
(k + 1] terms of the above expansion. It may readily be shown tliat if 
Q <i < I 

limn*/ fiOdi^O, 

Jn* 

and hence that 

lim n* f |fi*(0 \ dt *0. 

Jn* 


Using an expansion for the logarithm of 


1 

VirJi 


and the asymptotic 



expansion for the logarithm of the Gamma function, the following asymptotic 
expansion may be obtained, log/(<) - i log 23r — ii* + w, where 


(8) 




<?>*+> 




Gitut being a polynomial of degree 2p+2j and 

'*'1 ^ (P + 2)m>"** “ (p + 2)tt'-M’ 

A+i 

\m ( » 

' (p + l)n»« 

(p + l)<p + 2)fl'>+‘ (p + r)(p + 2)ni-+i' 


where 0 < at < 1, 

% 


where 0 < p < 1 j 


A bting u constant independent of n. 
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Thus, using Taylor's expansion, we obtain 

. .. 

2t ' 3l 


/(O = ^ e“*'’ (l + w + + • • . + ^ + JCU. c'* 


). 


(is + 1)1 

where 0 < < L 


Evidently is of the form 
fo’i _i_ ffl-t'* ■ gM-» 


+ • ’ • + 


^ w 


H-l 


„«J.+0 ' (jb+i)l 


■)]. 


the quantities q being polynomials in i; 

Using the moments of the normal distribution^ it may readily be shown that 


lim«* f" ' e-*'’ (%J + 


g*(p+0 


) 


=> 0. 


In thfi range of integration, when n is sufficiently large, it is evident that 

2n“ 2«‘^ . n + l,„ 

^ ••• +-^~ + — 


+ lfi;i + |!P„^,l if0<«<}. 


Thus 




and hence 




Kn*' 






«iC' 


where K and K* are constants, 


r 

lim n* j I E*(f) | d< < lim ^ 




We can also deduce the following results; 

1. Since the value of the integrand ia unaltered if t is replaced by we have 
at once 

lim n* j I BaCO | dt * 0. 

2. Using both of these results it follows that 

lim f I BaCO I df * 0. 

Hence 

3. lim ( B*(f) I rit 0, 

where t and <' have any real values, and thus it ia legitimate to integrate the 
asymptotic expansion of /(f) term by tenn with respect to t between any given 
limits. 
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4. If is a function independent of n which is bounded for all values of 
the asymptotic exponsioTi of in terme of n may be integrated term by 
term with reapeot to f. In particuIapT, if 0(0 an asymptotic expansion 
for the characterisijo function of ‘'Student’s'^ cUstribution may be obtained. 

We may now consider the form of the distribution of of + bf', and in order 
to simplify the argument, the following reasoning applies to the case in which 
the sample numbers are equal, although a similar theory may be developed for 
sample numbers whioh are of equal orders of magnitude. We may write 

m - Sh{() + Rk{th 
m = S,(t') + Rk{i% 


dtdu 

b 


tt = of + bf', 

and hence i* ^ ^ The joint distribution of u and i is therefore 

0 

[s,(os* + Rmk (^) + 

The distribution of u is obtained by integrating this expression with respect to f 
over all the po^ble values of f between and +^< The product 

fikCO^fc Jfe + 1 terms in the asymptotic expansion which 

is the product of the asymptotic oxpanaouB of /(f) and / ^ ^ 

mainder 0((), where 

(10) + A + 

Vi , va j * • • tfjb being polynomials in t. Let 

Bi(0 - «(0 + Skit) + 

Uring the expressions for the moments of the normal distribution, it may be 
shown that j \ 0(t) 1 dt = 0 upper bound of the bounded 

function Skit) for all values of n and f be jB* Then 

£|s»(^) BUo]* < B r |fl*(0 1 * 
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Similarly 

and 

J1 1 I* “ 

Thus 




= 0 


and henco the dietiibution of u may be obtained by integrating the asymptotic 
eapanslon whioh is the product of the aeymptoUo expaneiona of f(t) and / 
term by term. 

In practice, it is convenient to find the distribution of 


(11) 


w 


at + b( 

V^+T*' 


We substitute y 


bt — at* 

VST+T* 


distribution of w is given by 


and, using the above reeult, it follows that the 

1 


dw -t„. /■" -)»1 , 1 r(oui + iy)* _ » (oui + iy? 

JL- \ ” »* + 6’ 

L (6«» - ay)* „ (5u) - oy)* _ j_ 

(o» + i*)* ^ (a* + 6») 


i I 


•} 


dy 


whioh is equal to 

dw -jitfi /i , 1 r + 12«)^u*6* + + 6*) 

(12) r 


It may be noticed that this distribution may be expressed in terms of the 
ratio a/h only. The probability integral may. readily be obtained. There is 
no theoretical difficulty involved in obtaining any dosiied number of terms of 
this expansion, but they rapidly become too complicated to handle with any 
ease. Moreover, it is difficult to find a limit of tho error committed in using 
any given number of terms of the series for the probability integral os an 
appT03dmation to the value of this iiUegial, as somewhat complicated 
method of obtaining the series masks the form of the remainder. While it is 
undoubtedly true that when n is very large the distribution approaches nor- 
mality, and for a somewhat lower range of values of n the first two terms of 
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i 


the expati^on should bo taken, etc., it is difficult to forecast the number of 
terms which should be retained for any ^ven value of n. In fact the same 
difficulty seems to exist when using the original asymptotic expansion of 
"Student'a" dietiibution for tlm calculation of probabilities. For urstance, the 
coefficients of the powers of t which occur in the sixth term of tlie asymptotic 
expansion of the probability integral are larger than those occurring in the 
fifth term, and, in consequence, in spite of the greater pother of n in the denomi-. 
nator, for certain values of n these may contribute more to the probability 
integral than the previous term. We are unable to say anything about the 
aggregate of succeeding terms in general, and, therefore, it docs not seem 
legitimate to drop all the terms following a term which yields a contribution 
beyond the limit of accuracy desired. This difficulty is even more apparent 
In the oase in which the coefficients of the various powers of t occurring in the 
terms beyond the first involve also the ratio a/h, and it is probable that the 
different values of this ratio which are possible would lead to different numbers 
of terms being taken for the same value of n in order to gain the some degree 
of prerision in the probability integral. 


4. The distributions of the test quantities Which correspond to (3) and (11) 
for equal means, when the ratio of the variances is a known quantity. When 
the ratio ^ of the variances is gpven, the forngoing arguments, which are inde- 
pendent of the parameters specifying the distribution, may no longer be applied, 
for this would be information not supplied by the sample. In this case, the 
distributions of the test quantities which have been used take forma which 
depend only on the ratio of the variances, and ore independent of the sample 
esrimatee of the variances. 


The quantity (3), used in $2, when n was a small odd number, was 




where s* =» "* and n = JV - 1. On the assumption 

of equal population means, the distribution of this quantity takes the form 


(13) 


2r(n -f \) d» 



Thus in the case n = I, we obtain 


do r ' . 1 ' 1 

»(i + V)’ + i + ■*)^ (^ + ^ + i)*J’ 

which is the result given by R. A. Fisher,' The integral may be evaluated in 
tenns of elementary functions for small odd integral values of n- 

In §3, (U), the distribution of the statistic w e — was considered 

vs* + s'* 
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when N was large. The exact distiibution may be proved to be 

(U\ J+S r(ft + i)n"(l + <t>r . Tfi^jLX inn \ 

^ Vi («.** + »(l +^))"+‘r(n)^ \ ^ ' ' «»V + «(1 + i>)) 


where F ifl the hypergeometric function. If ^ 1, we have the limiting case 

in which the argument of the hypergeometric functioa is zero, and obtain 
"Student’s’’ diatribution, which is to be expected in view of the evidence stated 
in §1, the numbers in the samples being equal. 


CoimiBiA 'UNi'mem. 



SOME EFFICIENT MEASURES OF RELATIVE DISPERSION’ 

ByNhiAkNohrib 

For some time it has been known that the coeflScient of variation (in tho sense 
of the ratio of the standard deviation to tlie arithmetio mean) is not on offloient 
statistic for distributions departing materially from normality.^ At various 
times there have been proposed certain supplementary eatnmates of relative 
variation, such as those involving ratios between sums and differences of upper, 
and lower quartiles, and ratios of moan deviations to medians or to arithmetic 
meansc Some of these liave appeared in certain textbooks/ But there appears 
to have been no attempt to found tl^eic use on considerations of minimum 
sampling YDrianco* 

The point of departure of this paper is that of using the Method of Maximum 
Likelihood to derive two efficient measures of relative dispersion, together with 
expressions for their standard errors. These optimum estimates of true or 
parametric variation are the ratio of the arithmetic mean to the geomstrio 
mean (the arithmeti^geomet^io ratio) for Pearson Type III distributions, 
and the ratio of the geometric mean to the harmonic moan (the gcometrio- 
harjnonic ratio) for Pearson Typo V distributions. The usefulness of these 
measures is suggested by the goneralieed-mean'<vaIue-funQtion approach to the 
analysis of averages, especially the theorem of inequalities among averages.* 


^ Fresentod before a joW meeting of the Amorioan Bifttistical Asaoeiation and the 
Institute of Mathematio&l Btatieties at Chioago, lllinoiB on Deeomber 28, 1938, 

* The term "efllolent Btatiatle'* Is used here in the eetiao of K. A. Fieherj that is, of a 
parsmeter-GStimate which tends towards normality of distribution with tho least posslblo 
standard deviation. For a discussion of the inefficiency of certain commonly used statistics 
as applied to distvlbutionB departing from noriaallty, see R. A. Fisher, "On the Mathemati" 
cal Foundations of Theoretical Statistics," PHilosophtoat froasacKona 0 / the fioi/al iSocietif 
c\f Lcndan, Series A, Vol. 222, 1022, pp, 332^. 

’ See, for example, William Vernon Lovltt and Henry F, Holtzclaw, SloiiElici (Prentice- 
Hall, Inc., ^^ew York} 1020), p. 134; Herbert Arkin and Raymond K, Colton, Statistical 
MElhdE (Daincs and Noblo, Inc., New York, 1036), revised p. 41; and Hbrbert Soren- 
son, i^tatistiflS far iStudcRfs t'n Psi/cAofogjt and fiducotmn (McOraw-Hlll Book Cempany, 
Inc., New York, 1030), pp. 163/, 

* Nilan Norris, "Inequalities among Averages," AmaU 0 / MaUiAmlieal SlaiMcBi 
Vol. VI, No. 1| Mnrchi 1935, pp. 27-20; and "Convexity Properties of Qenaralized Mean 
Value Funotions," AnnahofMathomalicalSlalMcB^ Vol. VIII, No. 2, Juno, 1037, pp. US- 
120. Professor John B. Canning appears to have been the first to point out the possibility 
of making use of eertsin ratio measures of relative variation. See "Tbo Inoome Conoopt 
and Certain of Its Applications," Papers and Proceedings 0 / IHe Eleventh Annwl Ccnfetence 
of the Pacific Coaet Scotiomic Aeeomtion (Edwards Brothers, Ann Arbor, 1D3S), p. 84. 
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This theorem states that if < (s, then ^(ti) < ^(b), wheiv) the unit weight or 
simple sample type of generalised mean value function is defined as 


( 1 ) 




The are restricted to po^Uve real numbers not all equal, but i may take any 
real value* A neceaaaiy and sufficient condition that ^(- «) ^(2) ^ ^(oo) 

is the excluded trivial case that «« ^ . When the X{ are not all 

equal, the ratios between various pairs of averages as generated by yield 


ratio measures of relative dispersion, the usefulness of which depends, in part, 
on their effioienoy aa eatiniates of populatiou-oharacterising constants (param- 
eters). The arithmetic^geometrio ratio may be written the 

#(U; (f 


geometric-harmonic ratio may be written 


*(0) 

^(-1) 


G 

W 


In certain coses it 


may be of convenience to reverse the order of each of the ratios. The standard 
errors for the two forma which each of the ratios may assume are presented 
below. 

The demonstration that these ratio measures of relative dispeimon are 100% 
effici^t statistics for their appropriate distributions, and the derivation of use- 
ful expressions for their respective standard errors both may bo accomplished by 
the Quinary method of differentiating the logarithm of the likelihood. 

d 

Lot digomma oix — 


and triganmifl of ^ 


I.****' 


For Pearson Type III distributions, the frequency with which the variate x 
falls into the range dx is given by 

9) 

« 

The parameter a meaeurea the absolute dispersion of the distribution, and the 
parameter p determines the general shape of the frequency curve. The relative 
variation may be regarded as a population parameter, defined as the ratio 
of the population arithmetic mean to the population geometric mean. Let the 
logarithm of the likelihood for this distribution be represented by L, we have 



(3) L -n log pi “ n(p + 1) log fl + S \ogXi - 

where the summation is taken over the n individuals of the sample. It follows 


that 

( 4 ) 


Ba 




and 


d L / I "1% ^ t«ii. 


n 

o> 
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'When L is maxiioized with respect to it by equating to soro the first derivative 
of L with respect to a, we find 


< 6 ) 

It {i 1 bo follows that 
( 6 ) 


^«a(p + l). 

71 


BL 

— = — itPoCp) - fflogo + Slogaf<j 

Op 

a’i „ , . . a*/- a’i 

ap* aajp ** gp8o 


n 

^ ^ i 

a 


When L U loaximized with reapect to f by equating to aero the first dorivative 
of L with lespeot to p, we find 


(7) 


(naif)" ^ ac 


F^tn) 


The optimum estimate p of p is therefore found from (5) and (7) to be given by 
the equation 


(8) 


(p + /(na,)^ ■= I 


But (p -f is the parameter 9. Hence we find the optimum estimate of 

A 

0 to bo 77 , which can be expressed in terms of the pnSralised mean value fund' 

tion as . Therefore, for distributions well graduated by a Type III curve 
the optimum estimate of 6, the ratio of the arithmetic mean to the geometric 
mean, ifl^veiiby^. 

If only p is being estimated, (a given) the variance, or square of the standard 
deviation ofp is obtained from and is V{p) ToafirstapproxU 

A 

mation, the variance of 77 , the estimate of is found from the usual rdatton 

u 

between, the variance of a funotion and the variance of the argument, namely 


m 


m 

therefore 

(U) 


Vim - 

I® - 'L-TI - "’<”>] 


'A 

FI- 


- ml 

nFf(p) * 
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or the standard error of d Is the square root of the last expression, if only p is 

being estimated. If it is more convenient to do so, one may reverae the terms 
in the ratio to obtain 


( 12 ) 


^'7 

A. 


B' 


'"-M - mT 

n^’r(p) 


and extract the square root at the last expression to obtain the standard error 

of ■j , 

A 

If a and p are being estimated simultaneously, there exists the matrix of 
negative mean values 


(13) 


\daa/ \Badp/ 

-iw) 


i(p + i) 

a* 


n 

a 


n 

a 


nFrlp) 


from which tho variance of ^ can be computed. In fact we have 


(14) 


V(p) = 


p+ 1 


1 


B[(p -|- l)fi'r(p) - 1] 


and consequently 
(16) 


n ?,■(?) - 


A . 




n 


The standard error of ^ is equal to the square root of the expr^ion in (15), 

if both a and p are being estimated. If the terms in the ratio are reversed, 
one obtains 


(10) 


F(|l 
A 


M?) - 

- ii-a L P + IJ 


tt 


The square root of the last expreafflon may be taken to derive the fitandard 
eiTor of Since the digamma and the trigamma functions have been tabu- 
lated for considerable ranges,^ these standard error formulae, and those de- 
veloped below for the Type Y case should be quite useful. 


* BHlUh AsAoefation for the Adtranc^flisfU of Science: A/atTismaiicel TahUe (OJflce of tho 
British Asaoaiatlon, London, 1031)| Vol, I, pp. 42-61. 
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For Peftrson Type V distributione, the frequency with which the variate z 
fella into the range ds is given hy 


(17) 


df 


plW a' 


The parameter a measures the absolute dis^^orsion of the distribution, and the 
parameter p determines the general shape of the frequency ourve. The relative 
dispersion may be regarded as a population parameter, defined os the ratio 
of the population geometrio mean to the population harmonic mean. Let the 
logarithm of the likelihood for this distribution be represented by L* 'Kieii 


(18) I “ - n log pi + n(p + 1) log a - (p + 2) S log iP{ - , 


the summation being token over the sample of n individuals. It follows that 


(19) 


SL 

dp^ 


— TiPaCp) + n log 0 - S (eg Xi ; 
-nPrip)] 


da 


2(p + l)-si; 

a Xi 

-5(p+i)j 

a* 



=3 9 ^ 

dpda Badp a 

Let L be maximized with respect to p to derive the geometric mean, and let L be 
maximized with respect to a to derive 1), or the harmonic mean. It is 
clear that for the Type Y distribution, the relative dispersion, os we have defined 

it, is the population parameter ff' « , Therefore, if ^(0) = G «= (n®i)" , 

p + I 

and 1) = ff = -j — r , it followB, by an argument Himilar to that used in the 

- 2 - 

n 

case of a Type III curve, that the geometrie-hannonU* ratio, is an optimum 

estimate of the parnmeter 9^ for distributiona well graduated by the Pearson 
Type V cum. ■ 

If only p is being estimated, the variance of p is given by V{p) = j wid 


( 20 ) 


(I) 




(p) - ~T 

P + u 


nFr(p) 


nFrip) 


i 
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G. 


or the standard error of ^ is the square toot of the last exprcsaion, if p alone is . 
being eatimated, a being given* If the terms in the ratio are reversedi 


( 21 ) 


(!£) - 

\ 0 j nFAp) 


H 

and the square root of the last expression yields the standard error of 
If a and p are being estimated simultaneously! there exists the matrix 


( 22 ) 


\ 9a*/ \ao3p/ 

\dadp/ Vapv 


^(P+ 1 ) -T 


n 

a 


a 

nFrip) 


G 


from which the variance of ^ can be found. In foot 

A 


( 23 ) 

and hence 

( 24 ) 


V(i>) = 


1 


»[f,W - 


0 . 


y(„ = 


The standard error of is then given by the square root of the expression for 

ti 

V(V). If the terms in the ratio are reversed, 

08) ’'©-‘'"['■'W.-fil]’ 


the square root of which yields the standard error of 

Just as the coeffleient of variation is an efficient statistic only for distributions 
well graduated by the normal, or Pearson Typo VII curve, so also the two maxi^ 
mum likelihood estimates of relative dispersion heroin developed are efficient 
only when applied to their appropriate diatributions. One may expect to 
obtain an optimum degree of efficiency only when tho arithmetic-geoinetTic 
ratio is used for series welt specified by the Type III function, and the geometric- 
harmonic ratio is used for series well specified by the Type V function. 

It may be recalled that Karl Pearson proposed tho use of the coefficient of 
variation late in the nineteenth century.^ Since that time there appears to 
have been some tendency to rely on it as a measure of relative variation, regard- 


* “IlegrcBsion, Horodityi und Faninixia/' Philnophical Traniactioni of the Ropal Society 
of Londont Scriofl A, Vol. 187, 1890, p. 277. For matcrialfi pertaining to tlto Ponrson-Thorn- 
dike oontroveray roBulting from the Utter's auggeBtlon' that tlie ratio of the standard 
deviation to tho square root of the arithmetic moan is of ton a'mnro suitable dovicn than is 
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leas of whether or not it extracte from the sample a relatively large amount of 
the pertinent information concerning the parent population/ There ore several 
cases in which the coefficient of variation ia not m optimum estimate of relative 
dispersion. For example, in a comparison of the true or parametrio variation 
of the weights of humane of given age levels, the arithmetic-geometric ratio ie 
often the appropriate statistic to use, since weights tend to be distributed 
according to the Pearson Typo III law. Frequently the distribution of wraghts 
ia very well graduated by the Typo V function, if the origin is fixed at 0 in 
advance, Alfehou^ this procedure yields a special two-parameter Type V 
function, the principle of using the geonxetric*harmonic ratio as an optimum 
estimate of relative dispersion is still valid. Again, in a comparison of the 
rdative -variation of the personal distribution of wealth and income in certain 
modern countrLes, the arithmotio'geometrio ratio will be found to have a smaller 
sampling variance than that of the coefficient of variatioti, mce the personal 
distribution of wealth and income in tiiese countries tends to be in accordance 
with the Type III law, rather than the normal law. Similarly, the distribution 
of the number of trials required to obtain r auccesfies of an event having a given 
probability usually follows the Type III functian, and requires the use of the 
arithmetiG-geometric ratio, if the maximum amount of the relevant information 
is to be extracted from the sample. 

It seems clear that in practice the usefulness of the arithmetic-geometric 
ratio and the geometric-harmomo mtio will depend on the type of the distribu- 
tion with which one is dealing, and on the extent to which added efficiency is 
desired. In certain cases there is doubtless room for some difierenoe of opinion 
as to whether or not the degree of added efficiency achieved by the use of these 
maximum likelihood estimates of relative dispersion will merit departing from 
the use of suoh a time-honored statistic as the coefficient of variation. If one is 
interested in avoiding the assumption of normality implicit in methods cus- 
tomarily used in the more general problem of analysis of variance, an alternative 
ia the use of ranka.^ Although the efficiency of these rank-correlation methods 
ia not always 100%, their economy of effort is sometimes a great advantage. 

HcNTBR CoLtnOD QV THB OlTT OF NsW YOWC. 


the coefficient of SrftrietiQ& see Edward L. Thotndike> ^nSmpirical Stodlea in the Theory oC 
MessuremeAt," c/ Piychology (The ScieDoe Froes, New York, 1907), Vol. 1, No. 8, 

April, 1007, pp. 0-13; and Ari IrUroduclion to the Theory of Afonlal and Soa^al Afeasurmania 
(Teaohera College, CoUimbia tlAiveraity, Now York, 1013), Od. ed. pp. 133 or let. ed., 
1004, pp. 102/. See also Helen M. Walker, jSfludt'c^ in the Hietory of Statiatical Method 
(The WilliamB and Wilkins Company, Baltimore', 1920) , p. 178. 

'C/. Walter A. HecidrtokB and Kate W,, Bobey, '^Tho Sampling Distribution of the 
Codfioient of Variation," AnnoU of Mathmaliced Statiatioe, Yol. Yll, No. 4, December, 
1036, pp. 120-132. 

* Harold HotolUng and Margaret Eicharda Pabat, "Rank Correlation and Teste of 
Signifioance Involving No Assamption of Normality," Annals of Malhematieal Statialica, 
Vol. yil| No. 1, Maroh, 1036, pp. 20-43. See also Milton Friedman, "The iJse of Ranke to 
Avoid the Assumption of Normality Implicit in the Analysis of Variance," iToumaf of the 
Amertcon Sfolfslieal AanoeiaHon, Vol. 32, No. 200, December, 1037, pp. 676-70). 




NOTES ON THE DISTRIEtlTION OF THE OBOMETRIC MEAN^ 

By Burton H. CiUfp 

Thera arc two transformatioii theorema which a{qi>iy portioulariy we^l to the 
diatribution of i product and therefore to tiie diatribution of the geometric 
mean of a sample. Both are implicit in ^e known theory of the tranaformatiou 
of integrale, but it is useful to state them in forms which are especially adapted 
to probabiHty theory. Several examples will be conadered in which disMbu* 
tions of the geometric mean will be derived by usbg these theorems, 

The first theorem may be stated as 

TMeobeu A: Let the poitU set q in m N-dimensimi vrspace be defined so ^ 
inqa gim function of Ote u's, F(ui, Uf - air)haaOu property that 

(1) « < f < « + dt. 

Let q bo the eUmentary vohme of ^ peinl q d^ned os a» N-^k integral 



taken over q, having a value of order df. lA 

(2) t = 

be eonUmout and differentiaide nrnotonk functions of the t's with unf^ue tnverees 

(3) U = f\ut). 

Let r &e the pofnl set in t-space corresponding login u-space under Me transform" 
tion (2) ivt'M elementary volume given by Me integral 




/ 


f ^ { dli • * • di/f » 


di dt 

If Jib) is define as ~ ~otappiniingforwhidiF^f,ondif,foraUpomi$ 

dUi uUjiT 


vaq, 

( 6 ) 


dtj dtg 
dm"' due 




When Jkf is a constant, indspendent tf q, Men the volume f, is, accept /or terns of 
order (d(}', gum by 


(fi) 


-mi 


^ Read at a joint meeting of the Amerioaii Mathematioal Sooioty and the Institute of 
Mathematical StatbtipSf Indianapolis, Decomber 30, 1037. 
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The proof is immediate for we have 



But| by (5)i the integral in the Inst line hoe a value less than $ Af and $ is of 
order df. Therefore f differs from 5l./(f)| by terms of order 
Let ue DOW apply this tlieorem to a simple ease. The volume of tlie set 
where f ^ + - • « + < f + < o, t =s 1, . . ■ , JV, can easily be shown 

to be 

g «= <7(Ara -- d(. 


Let Ui ^ log h. Then it follows fiom the theorem that 

f - K ^(Na - (if, 


f being the volume of the point set r, where 

(7) f ^ log (fl • ' ■ ijv) "n f + ^f{. 

By the use of (?) one can now use the geomctrioal method of finding the proba- 
bility distribution of the geometric mean,- 

(8) !P (ii ■ ' • 

of samples of N from tlie universe ^(f) df, provided that ^ (t) ■ - • ^(tw) ia a 
continuous function of Unfortunately there do not appear to bo rnony suoh 
^ functions. One that is of interest is 

t[t) cU « fct** dt, 0 S t < d*. 

Let I^({)d£ represent the distribution of f. We have 

D{f) d( ^ J 0(h) ■ * ' 0(^Af)dii ' ■ ■ d^jff ^ * • * iy)*"di| * * • dijf 

f 

Thence we obtain as the distribution of tc; 

fCx)dit » ^logi)^"’‘daj. 

The form of f{x) in the special case in which s « 0 and 0 is a rectangle has been 
found by other authors/ and is 

/lx)dx « - log x)^^^dx. 


^ E.g. Bee 6. KuUhaohf '^An appUoatlon of oharaoUniBiic fuAOtloDB to the distribution 
problem of atatiatie^i” Anna^ of H/edieinajioat vol. 6 pp, 2Ca'‘270. 
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The second transformation theorem to be used may be stated og. . 

THEoms^M B'i Let be tho probability sUi/nenlfor a given universe and tel 

Uie sartvple (uii ui. * * ■ tj«r) be takejL Let the stoHetic { » 7(^1^ < Ujv) /lave 

(he distribution F{i)di. If the tran^omation (2), eati^yii^ ihe condiiione inh 
poeed on il in Tbeorm A bo applied boUi to the universe arid to the stoHsHCf yielding 
^{i)di and f = g{ti, ■ * ■ tj?) respectively , then the element of distribution of as 
obtained from 4 *j is, as htforoj 

The proof is straight fon^ard, for tho distribution of as obtained from \|'(u)dt< 
is given by 

• • ' \ff(Uir) dUit ■ * ■ dUtt 

and, as obtained from ^{t)dtf it is 

^(tl) • ' ■ 0Ctff)dlij • • • dly 

where q is the set in tirspoce where J < 7 < { + di and f is the sot in tepace 
where { ^ g < { + d$. It is clear that these two integiola have the same value 
because of the relation 

Mdu = ,^(fl(0) 




and the unique correspondence between the points of q and r set up by the 
transformation (2), with its unique inverse (3). 

This theorem is particularly well adapted to the derivation of the distribution 
of the geometiio mean because of the simple logarithmic transformation con- 
necting the sum and the product of N numbers, and because several distributions 
of the sum are already known, Two of these oases will now be presented. 

ExAMPiiB 1, Let a; be the geometric mean (8) of the sample of N from a 
universe with distribution law 


(9) 

Then the distribution of ^ is 


( 10 ) 


/(ai)£te 


x«+‘r(iVp) 


(i > 1). 


(a > 1)1 


and it is to be noticed that x ban the same type of distribution as i, 

To prove (10), first let £ — (ttt + • • • + 'where the u's ate a sample 
from a Type III universe, 


i^(u) du 


«-ll D-^l 

C M . 
du 


r(p) 


(m > 0). 
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Irwin’ has shown that the distribution of | is 

( 11 ) 




rm 

Making the transformation u ^ log tf we have 


I j 


« > 1 . 


and is unchanged* We now obtain f{s^)dx by substituting { » log a; in 

Example 2. If x is the geometric mean (8) of a sample of N from a universe 
whose distribution U 

0(0 dl a — ^ e~ W di, 

tevS** 


( 12 ) 

the distribution of x is 
(13) 


(c, f, <7 > 0), 


f(x) dx ^ -^~=. e ('“"«) (iaj, 
xcyiir 


> 0 ). 


To prove thiSi one bc^s with the arithmetic mean $ and the universej 


^(u) du 


1 - («-«)* 


0\/S 


le* 




du. Hero F(() rf{ = e >«> 

cy27r 


d(. 


Again usmgu = log ij one obtains f ^ log , iyy^^ and 


0(0 dt = J_ b“ *«'• s) d(, where (? = a® > 0 , 
lcV2ir 


and F(i) df is unchanged. To get (18) one Bubetltutes f » log in F(£) df. 
Again it follows that the geometric mean has the same distribution as the 
universe except for a change in one of the parameters (e) . Tliis frequency curve 
has other interesting features. It was developed by Galton and McAlister* by 
quite a different method and W'os called the curve of equal facility* They were 
seekmg for a distribution ^(0 which would have the characteristic tbat| if t and 
t' Avere two observations differing from (? by the same relative amount, (0 - t)/t 
» (t' - G)/Oj they would have equal probabilities. McAlister noted various 
properties of including the fact that 0 was actually its geometric mean, aud 
that it was not the same as the mode or the arithmetic moan. Certain properties 
which he did not mention are the following: 

(i) If one draws a sample from a universe with the distribution ^ in order to 


* Bimelrikai vol. 19 (W7), p. 220; aeo Mao A. Chursh, BtottieCfifca, yol. 18 (1026), p, 366. 
< This Cistribution oAfk also it obtained by the method of A. T. Craig, American Journal 
oj Mkemcticci vol. 61 (1932), p. 362, bub It a'onid be difheult bo evaluate his integral 
without the Bubstltutlon which would ho fluggoated U the dtetribution wore knovrn. 

B Proceedfn^^ of the Roffal Socieij/i vol. 29 (1870), pp* 306, 307. 



NOTBB OM GSOMETEIC MSAN 


225 


dotermine 0, the geometric mean of the universe^ the maximum likelihood 
solution is x, the geometric mean of the sample. 

(ti) The modal point of the sampling diatrlbution (/) approaches G as a limit 
as N becomes infinite. 

(ttt) One can devise a function s of the sample analogous to but different from 
Student's s, and sliow that x/s has a distribution independent of the parameters 
of G and c of the universe. To do this it is necessary first to extend the second 
transformation theorem so os to include cases where the number of statisticB 
(functions of the sample) being obtained simultaneously is greater than one. 
This is not difficult, but since the analogous tests for significance have been 
developed for the normal universe it would not be particularly usefulj for if the 
observations are distributed in accordance with thtir logarithms arc dis- 
tributed normally, and their logarithms can equally well be used for testing 
significance. 

(w) If one uses the curve of equal facility instead of the normal curve as the 
distribution of biological lengths, then any power of such lengths, in particular 
the third power, which is supposed to be approximately proportional to weights, 
would also be distributed in the same manner, except for a change in the para- 
meters. This is a property which the normal curve does not have. It raises 
the question: Can biological lengths be represented by the curve of equal 
facUity? The remainder of this paper will be devoted to a disoussiou of this 
question and cognate matters. 

The curve of equal facility may be made to approacli as a limit the normal 
curve if the origin be moved indefinitely to the left. This is almost intuitively 
evident from a consideration of the hypotiieses under which the two curves were 
derived by Galton and McAlister, It is also indicated by the behavior of the 
lower moments. Let Vi refer to the tth moment of ( 12 ) relative to the origin 
of t, in to the corresponding moment relative to the arithmetic mean. It is 
easy to show that 

(14) = GWe**’**, t « 0, 1, . . . , = ! - Gh, where h = e^\ 

(15) fi, = (fk\h^ - 1), n, = » 3ft* + 2 ), 

in = GV(A** - 4ft' + Oft* + 3), 

!«. = = (ft* + 2) (ft* - I)*'*, 

U = in/iil = (A* - 1)* + 6(A* - 1)* + 16(A’ - 1)* + 16(ft* - 1) + 8,. 

Prom (L 6 ) it follows that ae h approaches unity 09 and a\ approach their normal 
values, 0 and 3, respectively. If at the same time ^2 is kept constant, it follows 
from (16) that CP and therefore i become infinite. So the origin is moved an 
infinite distance to the left. 

The question, then, whether the curve of equal farility may be used equally 
well with the normal curve to represent biological lengths depends on whether 
in practical cases the natural choice of origin, which ts the position indicated by 
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zero length, is Buoh aa to make the two ourvea practidally indistinguishable. 
Tbie is apparently the situation in the case of human statures. For 8585 adult 
males bom in the British Isles* the values of the several conatanta, obtained by 
80 fitting ^(1) to the observations that the mean and standard deviations agree, ' 
are as followsi I « 67.40 in., 0 « 07.411, a ^ 2.56, h =* 1.00072, observed 
Off e 0.0125, oj for ^ = 0.11 ; observed a* = 3,149, at for ^ » 3.02. Thus for the 
curve of equal facility <x^ is further from the observed value than for the normal 
curve, but oi is nearer to its observed value. In both coses the difference is 
unimportant. A graph of both curves^ would not make it clear to the eye which 
of the two fitted the data better, 

It would be expected that the distribution of the cubes of these statures, being 
roughly proportional to the weights of the men, would not be normally dis- 
tribute. This also can be verified earily, for the distribution of (y « from 
^(Odt is ^(y]dy except that ck replaces c, and (f replaces G. So the distribution 
of cubes is: 

F(y) dy - dy. 

3oy\/2ff 

If this curve is fitted to the cubes of the statures, oks == 0.23, and <Xi ^ 3.21. 
Both are considerably further from their normal values tlian before. For this 
case the corresponding value of A is 1 .0064. It is the closeness of this quantity 
to unity, or in other words the amallAess of the coefficient of variation, 100 
tf/I 100 (A* - 1)‘^", which determines how close the curve is to the normalt 
For the ataturca v/l = 0.0379. For the cubes of the statures? q/1 = 0.209. Its 
values in certain other oase^ are: length of forearm 0.06, cheat circumference 
0.08, strength of grip 0.20, visual acuity 0.39. It appears to be evident, there- 
foTo, that for many types of biometric measurem^ts, cepeoially lengths, which 
we know can be represented well by the normal curve, the cufve of equal facility 
is practically just aa good. In a given case it may fit a little better or a little 
worse. If we w^i the distribution of the arithmetio mean aa obtained by 
sampling from such data we may find it by supposing the universe normal; 
if we wish the distribution of the geometric mean we may find it by supposing 
the universe of a curve of equal facility. This device of substituting for the 
normal curve another type of curve which is equally good in practical cases, in 
order to find the distribution of a statletio which cannot be found easily for the 
nonnal curve, may perhaps be useful also for other statistics than the geometric 
mean. 


WeBLSrAN UmviiEsm. 


• Q, Udny Yule and M. Q. Kendall, An IntfQducUpn io TAaorg of SMUHob^ London, 
m, pp. 94 , 116, 167, lea, is 7 . 

’ fiuoti u on page 187, Yule and Kendall. 

* For the weights of a Bimilar group of men v/i m 0.137, and thus the two curves would 
be more nearly alike If fitted to weights than if fitted to the cubes of these statures. 

*yrom a long list with values ranging from 0.004D to 0.6066, compiled by Itaymond 
Pearl, .iUsdieaf Bim$try and StatidUcBt Philadelphia (1930), pp. S47-0. 



NOTE OK A FORMULA FOR THE MULTIPLE CORRELATION 

COEFFICIENT 


By H, M. Bacos 

There are many uaeful foimulas available for the calculation of the multiple 
ooiTelation coefficient in a Ie variable problem. Since it frequently happens 
that the regression equation is the primary object of the statistioBl analysis, 
the well knotvn formula 

n,9a...ii = j3H.«...fcrn + j5ia.M...*ru +i9u.9a...<*-i)ri* 

can be used to considerable advantage, While many different demonstrations 
of this formula are perfectly familiar, the one given in this note may prove 
of some interest. 

First let us recapitulate briefly certain facts about the regrcssioa coefficients 
and the multiple correlatioii ooe^etit. Suppose we have i: seta of N numbers 
each; 

Xn • Xi, 






Let be the mean of the ;^th set, and let Xjt = Xu- if, We then have k 
sets of N deviations from means, and we shall suppose the following k sets to 
be linearly independent: 

Su ®I» ■ ■ S!lJV 


Ciai Piaa * ■ 4:9# 


Sa XAa ‘ • . 

We shall consider only the regression of the “variable” Xi upon an , sa , • • • , 29 . 
Clearly the results obtained can be made to describe the regi'ession of any one 
of the variobloB upon the other h - 1 variables by rearranging tlie subscripts. 
As usual let.Xi , Xa , • > • , Xt have values which will make the sum of squares ' 

F(X8 j Xa j ■ • ' I X*) " S(2i{ — Xi2i< — XaSnr Xt2*<)* 

a minimum. For simplicity we shall omit stating limite of summation and 
understand hereafter that 2 means “sum for 1 from t » 1 to i » N," NeoeS' 


^For example, see W. J. Kirkhuni, "Note on the Derivation of tho Mullipio Correla- 
tion CooOlclent'', Thi Annals of MalhamlM SlatisHes, Volume VIII (1937), pp. 68-71. 

227 



228 


K, K. B^CON 


aflry conditions (which are easily shown to be sufficient) are that Aa , Xs , • . ■ j 
iinifit satisfy the equationB 

dF 

t ^ ^ — 2 S(®u — XaXsi “ * * ♦ » 0 

OAS 

&F 

ffiT ^ ^ * 0 


^ — 2 S( 2 w ^ X»«« Xya;ii — 

OAk 


Xfc^fcOafM ** O' 


These equations ate simply the "normal equations" for determining the re- 
gression eoeffidents. Solving them we obtain 

Xj = 


X* * blA.OT..*(Jb-l) • 

The equation of regression of on r ^ ; * * * i is therefore 

+ * * * + baJfe.M.*.{Jb-j)iPjfc . 

If we let 

Uj ** bis.34...AXa4 + + * • • + hu<ia»«(JM)Xjb 

for i » Ij 2 | ' • - 1 then i^u is the re^dual of the »-th soi . The 0De& 
dent of multiple eorrelation of xi in terms of asg , ^3 , ^ , iTA is defined to be 

the simple eorrelation eoefilcient of the %*s and u'e: 

=® 7 / ■ " aV a > 

In case it ifl desired to express the x^b in terms of their standard daviationsj 
the following equation ia used; 

a?b 


or 


where 


®i _ fl ^ j, fl j- 

— = Pii.a 4 ...jb — r r • • ■ t — 

4^1 Ck 


- Si » At-t4> . ^ + /9 w. 94- 'Jfc e# + ■ ' • + ftjfc .33 ■ • • (*-t) 
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and 



Now if XAiBi = Oj the set of numbers il| ,A^, - « < f ^ jir is said to be crihogonal 
to the set of numbers , By , Hence the conditions of equadone (1) 

may be described by saying that the values of Xz , Xa ^ • , Xt must be such 
that the set of residualB u{ is orthogonal to each of the ^ — 1 sets of 
numbers xnj xa , " • , a&itf • But if tiie set of reriduals is orthogonal to each 
of these sets, it is orthogonal to any linear combination of them, ffince the 
set of u'a is such a linear combination] we have 

S(a?u - Ui)ui = 0 

and hence 

(3) SiCiiWi = Su? . 

Since U{ + ‘'* + it follows at once 

by multiplying both sides by ir^ and summing that 

(4) =* hii M.-.jSaiuajz,- + baJ'S4*'‘it2xui8( + • ■ ■ + . 

Writing 

^ Nffiffjris 


SoyKiCAf “ , 


noting the relations between the b’s and the /?’s expressed in equations (2), 
and observing that w’o may write 


,2.TifUc ™ 


(£a»»i)* ^ (SanUi)’ 
2£|(U( 2i{J 


bccauae of equation (3), we may therefore rewrite equation (4) as follows 


(ZanUt)* 

Sv? 


98 9a 


I I « 


+ ftA 


Now divide both sides by ^ = Na\ obtaining 


^ lifu + Pia.^e.-Aria + • • • + 




.This is the formula which was to be established. 


STANroRD Univbhsity. 







NOTES ON HOTELLING’S GENERALIZED T 
Bt P. L. Hhu 


1, Frequency Distribution When the H^othesis Tested is Not True 

a. The Problem, Let the simultaneouB elementary probability law of the 
^(/ + 1} variables st and sir L 2, • • . , ft; r » 1, 2, < • • ,/) be 

I 

where 

vu = ^ s|rs|f (t, j ® 1| 2, • ' • , ft) 

r^l 

C stands for the matrix || cu || and | C | , the corresponding determinant. It is 
required to find the elementary probability law of the statistic 

where | V ' | b | | and V | / denotes the oolaotor of the element o| ; in the matrix 

II Vii || . 

' The quantity /T is a generalization of "Student’s” 1 considered by Hotelling 
[1]*. It is an appropriate criterion to test the hypothesis, say Ht , that the fi in 
the parent population os given by (1) all vanish. The distribution of T when 
the hypothesis ffi is true has already been obtained by Hotelling. But our 
knowledge of the test is hardly complete unless we know also the distribution of 
T when the ^ do not all vanish, Indeed, only such a knowledge can enable us to 
control the risk of error of the second Idnd, i,e. of failure to detect tliat Ho is 
untrue [3, 4]. 


b. The Solution, LetH be a ft X ft non-singular matrix such that H'CH = I, 
the unit matrix, where ff' denotes the transposed matrix of H. Let the sets of 
variables (d , si , • ■ ■ , st) and (si^ , Sir ) > " t *Jkr)(>' ■> 1, 2, . • • /) be subject 
to the same coUineation by means of H, so that 


11*1, ss, 

ll*;r, 4, 1,2, ■'•,/) 

where the t{ and t[f are the new variables. Let further the quantities n be de- 
fined by 


* Ref^nboeB ate glvan at the end of the paper. 
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(2) Ijfi) fit • * ■ if*l| = l|ri, Tj, • •• , ritll'J?'. 

Thou, 08 is easy to verify, the simultaneous distribution of the new variables 
will be given by 

(3) pi((. f) « Ij i(i, - T()* + wh)], 
while the statistic T, os a function of the t's, retains the original form: 

(4) 

where 

ttl/ it tirifr (i, i ^ 1, 2j • " I fc), 

r*l 

I r/' I * I Wi/ 1 , And UijiB the oofactor of the element in the matrix || || , 

By virtue of (2) we have the following Tolatiou between the old and new para- 
metric conatanta; 

tt fc 

(5) 

«-l <,/-! 

Our problem ie thus reduced to finding the derived distribution of T defined by 
(4) from t^ parent population given by (3). 

We solve this problem by obtaining an expression for the Laplace integral 
i.e. the mathematical axpeotation of for real non-negative A few 

words are perhaps needed to explain the faot that the Laplace transform of an 
elementary probability law determines the latter uniquely except on a null set 
of points. If f{x) is an elementary probability law whioh vanishes for all negop 
tiye X and if 

for )3>0, 

i 

theh| letting c be any fixed positive constant^ we have 

ff(c — fl) ^ J dx 

for all /9 ^ c. We get therefore . 

Jo flp' M 

the definite integral being obviously ‘finite for all h > 0< Now a sufficient con- 
dition that the set of numbers determines the function e^/(x) uniquely, 
vdth the exception of a null set at most, is that the latter multiplied by 
be summable (0, oe) for some positive k (<^. [6l» p. 320). Since this condition is 
trivially satisfied by the function this function, and therefore /(«) itself, 
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must he uniquely determined by the m* . In other worde, /(*) ia uniquely 
determined hy its Laplace transform b 09). We now proceed to find the Lnplnco 
integral 

Introduce the function 

ff(ij a) “ (\/27r)* I U* I* exp uljSi&i + 2ia ^ 


and write 


P(<, a) = pi(i, i'j «), 


where all the argumenta take real values only. For any functions tp{e) and 
^(2, i^) let UB write 

J ip(0) — j j v(^) d^i * * ’ d$u 


We have 

I d(i, If) 1 1 Ht, i', «, «) I iff « j pi{t, t') d((, t') j g{t, t', 6, 0) ifl = 1 
whence we know that 

(6) J d(t, t') j Fd6^ J j ^ 

On the right-hand aide of (6) we find 

j Pxit, 0 d{t, if) j g{i, if, e , «) dfl =■ j 0 d(i, if) = 

while for the integral on the right-hand side of (6) we have 

j Fd(i,0 

(7) = (■\/%)~*^'*^^ ’’0/ [" L? - Til j dt 

X f 1 1/' I ‘ »P [ - 5 + h) tttf] d(', 

where we mean by the itf the quantities 

(ij^ 1,2, 

dn = 1 

In the equation (7) the integral with respect to the it is immediately written 
down BB 
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(V2ir)* exp n £ (tj - 

As to the intogrttl with I'cspect to the i'ir i we may evaluate it by the method by 
whioh Wilks [71 evaluated the inomeats of the generalized variance, TIa 
result is 


Making the substitution into (7) we got, after necessary roduotions, 




_ nf _ 

whence, noUaing that 1 1 =’ 1 + S ^ 



Equation (8) gives the Laplace trsmaform of the elomeiLtary probability law, 
p(r), of r. ' There ia no essential difficulty in getting f{T) by inveraiou directly 
(from (8). Neverthelese, it may be of interest to get p(r) indirectly by identi- 
f^ng the right-hand side of (8) with the Laplace transform of another ele- 
mentary probability law which is otherwise known* For this purpose connder 
the simultaneous elementary probability law 

M - «P [-! I - W - 1 ^ !^] 

and let us find the derived distribution of the statistic 

i = a* / 

I 

As before, we introduce the funotion 

ff(», y, e, a) = ( V2ir)"^' exp y* ^ fi? + 2to ^ 

write 

F{*> y, a) - p(is, y)9(a, Vi 9, a) 

and ascertain that 
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(9) j d(x, y) j FdO Bs j j yj 

On the leftrliond side of (9) we find 

f r*“’''p(®, y)diz, y) = 




while for the integral on the right-hand aide of (0), wo have 
j Fd(,!S,y) = exp 

X f exp ^ {»' + 2(f(rfi “ i<)a!(j jd® 


+ /»)) 

fwi) 






«p[-5|5(«’fl) + 3wfa«<)] 


W^riting 

( 10 ) 

we get finally 

(11) 


fi = k, /,«/+!-* 


(V^)'*r(K.f + D) 
r(M/+i“W 




TVom the identity of (8) and (11) we conclude that T is distributed exactly 
the same as L with the appropriate "degrees of freedom" fi and ft given by (10). 
But the elementary probability law of £r has already been derived by P< G. 
Tang [6], Using his result we immediately write down the elementary proba^ 
bility law of T: 


(12) p(20 = 2 ii 


Al B(4/i -H h, i/O 




where /j and /a are given by (10) and 

(13) X = 52r!-g2 cuttt, 

in Rooordanoe with (6). The tables of probability integrals prepared by Tong 
can, of course, be used to suit our purpose. 
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2, An Optimum Properly of the T-Test. To any render familinr with the 
Neyman-Fearron theory of testing statistical hypotheses [3, 4], the theorem 
stated helow may be of considerable interest. 

Denote by W the h(S + IHimensional space of the Si and sjr and let tc be any 
region in W ivbicli may possibly serve os a critical region for the rejection of the 
hypothesis ffg . Ijot us speak of a oritical region w as belonging to the nlm) ^ ]) 
if u) satisfies the following condition; 

(14) f p(«, s')d(*|i*') “ < + 5 2 + E 

where £ < 1 is a poeitivo constant independent of the [i , and the re^on to, 
n is a constant depending on w only, but not on the or ca , and where for 
any fpven set of values of the cj; is an infiuitesinkal of at least the third order 
as all the j'f tend to zero* 

Thboricm. 0/ cXL (he regions Itelonging to the claas Z), particular region 
which gives the largest possible vatue to the coe($dent a (he egmUon (U) is (he 
region defined iyT > Tu where ft is a consfard so determined.^ the probabilUyi 
when oil vonisht of the observed T being na£ ieee ihm T« is exactly e. 

The signifioancD of the theorem is dear. Every critical region belonging to 
the daaa D serves &8 an unbiased exact test of the bypothei^a Hq j e being the 
preasslgned chance of rejecting if it is true/ Further, os is seen from (14), 
as the ti start to depart from zero, the increased ohanoe of rajeoting Hq due to its 
falsehood is approximately proportioned 'to the quantity The co- 

efficient a therefore meaeuTOB the power of the critical region w to detect the 
falsehood of Ho , at least when the departure of the from zero is small Our 
theorem asserts that in this partioular sense the T-test is the most powerful of its 
kind. 

The method of proof is very much tlie same as that by which Neyman and 
Pearson proved some of their general theorems concerning unbiased tests. How^ 
ever, as the present theorem has not yet been contained in their moi‘e general 
results, we shall give it a full proof without referring, save in one occasion, to 
these authors.' 

Pnoov. Write 

Ptf + »* Bij (if J ^ If 2f * ’ * f k) 

(16), P.(*, *') * exp [ 

and denote by po(e) the sinault^ous elementary probability law of the variables 
6i j derived from (1&). Let Wi be the domain of all possible portions of the point 
(sn I * 11 , » ' • , **») in the ifc(J + l)-dinQensional space. 

We know, ^thou^ we omit the proof of it, that there is no elementary proba- 
bility law of the variables an other than p^{s) which has the same moments of 
all orders as those derived from pa(z, s'), It then follows that if p(s) be any 
aummable function of the and if 
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(16) f ( n ijr) ?(s)p,(s) d» = 0 

Jwl \M"1 / 

for all poaitivB integei's or zero, then we must have ^(a) = 0 except perhaps 
on a null set of points. 

It follows therefore that the identity 

(17) / as 0 

Jvi 

implies the identity g{a) = Q provided gis) does not involve the parameters ca . 
For, substituting for po(s) its expi^esaion as given by Wisliart [8) we shall have 

(18) K f g(a)p,(a)dsm f f(») expF-^ £ = 0 

Jvi Jwt L J 

where [ iS | - | s;/ 1 and £ is some constant. Differentiating (IB) successively 
with respect to the Ca and dividing the results by K, we shall regain the equations 
(16). Hence it follows that g(a) s 0. 

This being established, let w be any region belonging to D and rewrite the 
equation (14), so that 

f exp «<((*< - fi)(«< - fr) + »m) jc!(*, »') 

b 

= * + 52 OfiUti + S 

Setting all the {*1 to zero in both sides of (19), we have 

(20) / Pi(«,if0d(iP,«') = e 

J« 

identically in the ca . Differentiating (19) once with respect to and after- 
wards setting all the f r to zero, we easily get 

(21) j ZiVai^i d(£, zO - 0 (t « 1, 2, • * • fc) 

for all possible values of the ca . 

Finally, differentiating (19) with respect to ti at^d then to tf Q^nd putting all 
0 in the result we obtain 

j 1^2 pft(«, d(z, $0 = otCif (f, j = 1, 2, • - fc) 

whence, renumbering (20) 

k 

( 22 ) ■ £ 

A.I-l 

in which we denote by j? ^ a + e and 


(19) 


(i,j ^ 1,2, ••■,*!) 
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9 m = J^SkeiMii,e'}d(e,e') 

If wc deitote by Q the matrix of order h formed of the elemonta g^i , we see that 

(22) may bo written as 


CQC B jJC, 

wlioncc, siiice C lias its inverse matrix, C~\ 

Q as /?(r* 


i.c., 

(23) 9</ = /3c}7” 



1 . 2 . 


9 4 9 


I 


k) 


wlioro denotes the oiemeut in the matrix which oorresponds to the 
element Cij in tho matrix C. 

Conditions (20)^ (21) and (23) are necessary for the region w to belong to the 
class D« They are mdently also sufficient. 

Let us evaluate the integrals in (2Q), (21) and the qt} by fiTst evaluating the 
surface integrals on any aurfaccj say 0($)t on whioh all the 8^ have constant 
valueSi and then integrating the results with respect to the Sf/ over a region, 
say tsi , of tho bj/ contained in Wi , Thus wo may write (20), (21) and (23) in 
the form 


(24) j /(a)p5(8)d8 a 1 , I i?4(8)po(a)d« a 0, ( v>«(fi)Po(«) « |3e{7^\ 

Jiffi Jvj Jwi 

(i,j - 1 , 2 , ^.^k), 

where 

wW - -t:? I t(Pc(e,g0dO(^) 

Paw M>) 

vtM ** ^ s') 


It is readily verified that the functiem jh(^i » 1^^ Irom the parameters 

Cii , and consequently so ore the functions /(«), (^((s). p(f(a). Besides, we can 
extend the definirion of these funorions in the whole domain Wi by assigning 
them the value zero outside of the repon . Doing this we can now write the 
equations (24) as 


(26) 


[ (A*) - e)j>i(®)d*"0| 


f W*) “ 
>1 


f c<(«)pt(s)d«* 0, 

>1 

Y%]Po(«)‘is*0 (i,J = 1, 2, •••,*:) 


where y “yqrjA 
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Now oil the equations (25) nro of the form (17); consequently, according to 
the already eatablishcd result and remembering the definitiona of the functions 
/(«)» PtW and wo must have 


(26) 

(27) 

(28) 


/ po(2^, ^0 dOia) = epj)(8) 

Jo {9) 

I 0ipo(2, a')dG(fi) = 0 
Jo(0 

/ ZiZipoiz , «') dG(a) ^ 7«fiPo(«) 
/<?(■) 


in the whole domain Wi . 

Hence the most general region belonging to the class D is constnictcd os 
follows. On any Biirface Sij = const, (i, j = 1, 2, . • ♦ ft) we take an areal region 
such that it satisfies the equations (20}-(28); wc then allow the a^ to vary in the 
whole domain Wt . Equations (28) may now be replaced hy 

(28') f pa(z, «') = 0, a, J = 1, 2, • • ■ , fc) 

J9{a) \8\l Sif/ 

Let us call the region defined by T > 7'i , Since belongs to the class 
D (cf. (12)), its ems section, say 0 o(a), by any surface Sfi const, (i, j = 1, 2, 

... , ft) must satisfy the equations (26), (27) and (28'). Since^ = (a + <)i 

all we have to prove now is that among all the areal regions 0(8) satisfying the 
equations (26), (27) and (28') it is the region 0 d(s) that gives the largest possible 
value to 7Pa(«) - N ow 


(29) 


7Po(«) = / r *' 

Jo(m) ail 


) 


Olid, according to a Lemma of Neyman and Feorsonj [3, p. 10] the right-hand 
side of (20) will attain its maximum value if 0(s) is defined by an inequality 
of the form 


(30) 


Sll \8ll 8ii/ «-i 


where the an , and c are constants so determined as to enable the region Oia) 
to satisfy the equations (20)-(28). We shall show presently that the region 
0o(8) is defined by such an inequality. 

The inequality T > T, may be written as 


hJ/l 




1 


f,6. 


or 


»n 4- zfif \ 1 + r, 


Sf/ — tjZf 


1 


i + r.* 
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(31) £ ^ rzV 

/i/-i 1 H- i • 

where S{7‘* denotes the (*, J)tli clement in tho inverise matrix of || Aif || « The 
region G«(a) is therefore defined by the same inequality (31) in which we regard 
tho 8ii as constants. 

If WG put 

1 

a<f = 6f - 0, c - ^ (i,j == 1, 2, • • • ,fc) 

in (30) we can easily reduce the inequality (30) into (31). 

The proof is now ooinpteto. 


3. Note on Applications of T» It is already known that the f-teat may be 
used for the following purposos (a) and (b); 

(a) Given a fc-vaviate normal surface 

!>(*) - exp [- j - !<)(«> - j 

with the unknown ^ and ca . n observations 


(®ii I JTai I • • • I 


(I ^ If 2| * • » I n) 


having been modSf it is required to test the hypothesis that the have the por- 
Ucular values ^5 for « « 1, 2, • , fc. 

Here we use the T-test with 


Wl 

« VnC^i — tS)) »!/ « £ (xi — — ^j) 


1^1 


whore 


. ?< ^ Vn (& ” €i)> / = n - i 


1 ** 

‘ E »« 


> (ijJ *= li 2, ,fc) 


(b) Given two Ai-variate normal surfaces 

Piiz) = (\/2v)'*C* exp ^ S <jff(jp< - {f){a;/ - iii) 

PaC®) = (•v/^)“^C‘ oxp i ct^Vi - ndiVi - w)) 


where the Ci^ are common to the two surfaces while all tho , oa are uq** 
known. Samples of «i and having been drawn respectively from the two 
popuIationSi to test the hypothesis that |r = vr for all u 
Let the samples be > 
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(«U J , ■ ■ • , 

(i = 1, 2, • • ■ , n.) 

and 

(Vikjltoi p2/m)) 

(A = 1, 2, ■ • • , n,) 

Let 

ni i-i nt ft-i 

(i-1, S, ••■,*!) 

We use the T-teat with 



^ fh "f Ws ^ + 2 

!# (vtt - - ft) 

'1 



-2 


(i,i * • pfe) 

A third application of T, which appears to be novel) ia the following; 

(c) Given a (ft + l)-variate normal surface 

p(») = 63Cp j^— ^ difiZi - " fe) j I i) «“ 1 dij 1 p 

where the and ore all unknown, n observations 

(®ii p as>/ 1 ■ ' * j “ Ij ■ • ■ » ?») 

having been made, to test the hypothesis that all the ore equal, 

If we put . ■ 

xt+i (^ " 1, 2, • * - , ft), 

then we have a ft-vaiiate tionnal auifaoe for the va;nables yi , 

v(y) " (V2ir)"*<?* exp [- ^ “ >?')] 

where iit - it - (hi ~ i) 2, * • • j ft). Thus the problem is reduced to testing 
the hypothesis that i]< = 0 for i » 1, 2, • * • , ft and therefore belongs to the 
type. (a). Write 

t/u = it<i - **+ 1,1 (i - 1, 2, . . . , fc; I - 1, 2j . • . , n) 

Bad 

fi. = 5 £ tfn I (t SB 1, 2, • • ■ , Ji). 

« 1-1 

We UBe the T-teet with 



m. 


P. L. SBU 


rt 

*= Vn ft, Vif = 2 (fftf " “ ft) 


1-1 


ft " / = n + 1 


— 1, 2, • i fc) 


Although there are no simple expressiona for the , there is one for the param- 
eter 2) Ci^ViVf f on which alone the distribiitioii of T depends. We have indeed 


fr 1 

E ctmi ^ n 


<rii • * • 

A>fl 

St 

1 

■ * • 

*+l 

ft+i 

1 

ft • * • 

ffc+1 

0 

0 

1 

1 

0 

0 


where 


D =. 


ffn •"* fl’i.w 1 

tTft+l,! * • • ffJt+l.A+l 1 
1 • • • 1 0 


where is the oovariance between xt and Xf . 

Expressing T in terms of the original variables we have 


r 

D' 


where 




Sll Sb* • • 


£i 

1 

* ■ * 

Sft4l,fc4.1 


ft • * * 

ft+1 

0 

0 

1 • • • 

1 

0 

0 

Sn • • » 


1 


Sjfe+Iil ’ ' * 


I 


1 * * • 

I 

0 



and where 

1 ^ j « 

- 2 - 2 “ %)i 

n i-j a 1-1 


0\i - l,2j ••• + 


Therrfore T is independent of which variable hae been taken as the (fc + l)fit. 
UznviaBiTT CoiiLioai Loncok. 

KEFSRENOES 

[11 B. HomiixaNOt Ann. Math. Siatiai., Yol. 2 (1931) pp. 859-^78. 




GENSRALIZATION OF THE lEEQUALlTF OF MARKOFF 

Bv A. Wam) 


1. Introductiott. Denote by X a random variable and by M, the expected 
value E I X - xt f of I X - int |' for any integer r where Xt denotes a ^ven 
real value. ISr is also oallod the absolute moment of order r about the point Xt . 
For any poellive number d, denote by Pt-d < X - xo < d) the probability 
that I X - So I < d< The inequality of Markoff can be written as follows 

(1) . P(-d<X-a;o<d)2:l-^' 


The, inequality (1) is also called, for r =< 2, the inequality of Tobebysoheff, 
The inequality (1) oan be written in the following way; 


P(~tVM, < X - «» < 2: 1 

Substituting in the above inequality s for r and | 

vJif. 


1 

r' 

for S we get 


(2) 





where r and a denote any mtogers aivd 1 denotes tm arbitrary positive velue,‘ 
Substituting in (2) 2fe for s and 2 for r, we g^ the inequality of K. Pearson.* 
By other substltutiona we get the formulae of Lurquin, Cantelli, etc.* 

As ie well known, the inequality (1) cannot be improved* for d ^ • 

That is to say, to every < > 0 a random variable K oan be given such that 


■ F|r-i!i,r»= FIX -01,1' and 


?(-d < F - a* < dD 



+ <• 


If the absolute moments Mj, <= F(|X-Xg|'')) *■* ,Mtf s FjX - «»|''of 
a random variable X are given (and no further data about X ate known), then 
we shall say that is the "sAorp" loufier Umil of P(-d < X - 3 ^ < 'd) if the 
following two' oonditions are fulled: 

(1) For each random variabioF, for which F I Y isF|X,-ao|*', ••• , 
F|F-a;or'*'F|X-®i I’', the inequality P(~d < F ^ »o < d) > ftr holds. 


* The fonvula (2) has bwn gim by A. Onldbeirgi CompteB Amdus, Paris, Vol, 17S, p. 679. 

* Vol. XII (191M010) pp. 284^2M. 

* E, Iiorquln, Cenptu Rtndvt, Faria, Vol 17S, P..981. Also Cantelli, AendiniKintl dille 
Seals Academia del LineH, 1016. 

^ 6*e for inalaaes, R. v. ItDisB, WahrselMtnlidiferitmshaimp, L^pilg, Vienna, Dsntlekt, 
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(2) To each « > 0, a random variable Y can bo given such that JS | K ^ a;# | = 
El X- 1, ,j) andP(-^(l <y“aJo<<l)<ad+e. 

In other words, cj is the limes inferior^ of the probabilities P(-d < 
Y - Xfi < d) fonned for ell random variables Y for which the vth absolute 
momont about the point xa is equal to the t>th moment of X about tho point 

fffl (r « 1, J). 

The ohaolute Mi ^ , , • ■ ♦ , Mt^ of a random varioMe 

X ore given obout the point , where j ia , * • » , i/ denote any integers and iif<, 
denotes the momeiU of order tV {»* =» 1 * • • fc). Hie required to calcidate the **flAarp” 
lower limit of the prdbahiUty P(-d < X - ica < i) for any posiUve value d. 

If only a single moment Mr is given, our problem is already solved, because 
the inequality (1) gives us the “sharp” lower limit for d ^ -^5^ and for 
d <^Mr the ^'sharp” limit is obviously equal to zero. But the case in which 
even two moments Mr and Mg are given has not yet been solved. The formula 
(2) gives us a limit for P(-d < X - aPo < d), but this limit is not "sharp ” 
as oan easily be shown. 

Wg shall give hero some results concerning the general case, and the com- 
plete solution if only two moments Mr and M» are given. We shall see that 
the "sharp" limit is considerably greater than the limit given by (2). 


2. Some Propositions Coacaming the General CascA Wo shall call a random 
variable X non-negative if P(X < 0) «= 0. ffinoe the absolute moments of 
the non-negative random variable Y = | X ^ xo\ about the origin are equal 
to the absolute moments of X about the point and since P(y < d) = 
P(— d < X — ®o < d), the following proposition holds true: 

(1) Denote by Mr, , • « • , Mi^ the ab^oltds moinerds qf order , • * • , t/ o/ a 
certa/in random variable X abotd the point . The limes inferior of the prehor 
UUties P(— d <. y — Jtt < d) is eq^tal to the limes inferior of ike prohabSiHes 
P(Z < d), where P(-d < K - aro < d) is formed for all random variables Y 
for whidt the absolute mownt about Xs is equtd to Mi^{v ^ 1, • ■ • ,i), and 
P(Z < d) i8 formed for all non^negativc random vatiabks Z for which lAe i^ih 
moment about the origin is equal lo Mr, (f = 1, * • * , i)» 

On account of the proposition (1) we can restrict ourselves to the considera- 
tion of non-negative random variables and of the moments about the oripn. 

A random variable X for which h different values , • • > , sa exist such 

that the probability p(a;0 of «r (i - 1, • < - , fc) is positive and 2 p(»0 = 1, 


is called an ari^metic random variable of degree A random variable X 
will be called f-limited, if P{— f ^ X < 0 = 1 We shall prove tho following _ 
proposition. 

(II), Ld ns denote by Mr, , Mr, , • - ■ , Mtj the absolute moments qf order 
iit ••• f if of a certain nonmegative random variable X, about Oie origin. Denote 
by n(itj 0 the set cf all non-negative t-lifnited arithmetic random variables of 


• The limsa infsnor of a net JST of numbera is the greatest value y for which the Ine^iuality 

y £ ae for each element x oS N holds true. This is also called greatest lower bound. 
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dtgm < k,/oriJ)hieh&ei,ffnnometUabotUtheorigini8egualtoMi, (yi, ... ,j), 
i) 48 nippined io he not empty* Denote further by a(d, k, i) the limes it^erior 
of the probobHHiee P(Y < d) formed for dU random oarirMee 7 the at ^k, (). 
Then wean say, There exists in Q(k, t) a random luridhle Zfor tehtch P(Z < d) « 

a(d,ib,t). IfO <a(d,k,i) < 1 and ZUarandone variable in Q(fc,{} for vhiek 

P{Z < d) B (i(d, k, 0, then there exist at most j ~ I d^erent positive vdbfu 
Xi , ■ • . , sueh that Xt ^ t and the prdbdbUily pixt) o/ X{ is poettiee 

’« = 1). 

At first we shall prove that there exiats a random variable Z in 0(k, t) 
that P(Z < d) » a(d, k, t), Shioe a(d) k, t) is the limes inferior of P(y < d) 
formed for all random voiiables Y in Q(k, t)» there exists in 0(k, t) a sequenee 
(Z() (t - 1, 2, • • ■ , ad inf.) of random variables, such that lim P{Zf < d) » 

a{d^ t). Arranged in aacending order of magnitude, the valiiee of Zi which 
have a positive probability are denoted by %i,i , Xi ,^ , • • ■ , . Since Zi is a 

^limited non-negative arithmetic random variable of degree < Jb, we have 
bj £ b and 0 < Xi,T £ t (r = 1, < • - , fcr). It follows easily from this fact that 
there exists a subsequence (i^ >= 2^ , ad inf.) of (2<| with two 

properties: Firstj that the variables Z(i , - - * are of the same degree 

(soy e)j that is to say ~ s (v - 1, 2, * * • , ad inf.); and second, that the 
sequence \Xi„r] (m = 1, 2, , ad inf.) converges for each integer r £ s. 

Let us denote lim Xi^,r by (r - 2, < > • , s]t and tlie probability that Zi, 

takes the value Zi,,r by It is obvious that there exists a subsequenoe 
{Zn,\ (r » 1, 2, • > • ad -inf.) of [Zi,] such that the sequence ipn,,f] converges 
with inoreaBing v. Let us denote lim pn,,r by pr , (r = 1, 2, > < • a). Since 

P-'OP 

I 

P4,.i + '* ■ +.P<„r = 1| Pr = 1 musli hold truo. We oonader the random 

variable Z for which the probability that Z = XriB equal to Pr (r ^ 

and for which no values except , • » * , ai*e possible. , The random variable 

Z ie obviously an element of ^t{k, t) and P{Z < d) = a{d, kj t). 

Let us conrider the case in which 0 < a(dj ft, t) <1 and denote by Z a random 
variable of Q(ft, <) for which P(Z < d) = a{dy ft, i)» We shall prove that there 
exist at most j - 1 different positive values a;i , • • * ^ that Xi ^ d, 

Xi ^ i and the probability p(a;r) of Xi is positive 1, 2, - • • , ; — I). In 
order to prove this statement we shall suppose that there exist j different posi- 
tive pointa ®i , • - jscjfluchthatxi iandp(»0 > 0 (i = 1, 2, r** j/)* 

Then we can write 

" Mi, - 


■ iifj, - z ®''p(»)i 

r“il 


^This is asrtainly the case, if we choojse ft and I groat enough. 
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whcro tih6 summAtions on the ri^t hd.n.d sides ate to be token over all veluee 
of a wMoh are diSerent from 5?i , ■ • • , and for whioh 3>(iB) > 0. 

Since P(Z < d) » c((i, ii, t) and 0 < a(d, fc, <) < 1 by hypothesis, there 
exist two non-negative values b and c, such that b < d, c > d, p(b) > 0, and 

p(d) > 0. 

We define anew orithmetioTandoiin variable Z' as follows: p'(b) » p(b) — e, 
p'(c) « p(c) + and for all other values p'(ic) = p{aj), where p^(ai) denotes 
the probability that Z* = x, and e a positive number less than p(b), Z* is 
obviously a non-negative arithmetic variable of the some degree as Z. The 
moments about the origin of the order ii , ^ , « « • , t/ of Z' will in general not • 
be equal to the corresponding moments of Z. However this can be obtamed 
by a small displacement of the points , • • • , a;/ into a system of neighboring 
points 3^, ••• provided that e is small enough, In order to show tbia, 
we have only to prove that the functional detenninant 


m 


<1-1 




<1-1 




p'(*i) • • • p'(^) 


of thefunotioiiB/i(2i, •••,*#)=> ••• ^ 

does not Tanish at tfae point Hi °° «i , ■ • • , = x/ . ^ce p'(xi), • • • 

p'(xf) are not equal to seiv> ve have only to show that 


®t‘"\ 

BS 

»i f • ■ • , *r j 



fi 

d?r # ' * ‘ Zf 


Xl 




where ^ ft can be assumed positive by denoUog by ft the 

amaUest of the integers ii,ih 
Let us consider the polynomial in 9 given by 


B(x) = 


sJlA s'*"** 


According to a weH-known algebraic proportion,' the number of positive roots 
of R(x) ifi less than or equal to the number of changes of sign m the sequence of 
ooeffidmits of jB(af)i Since the number of changes of sign in S(x) is obviously 
less than or equal to j - 1) the number of positive roots of R(x) is also less 
than or equal to j — 1, On the other hand as » , * • * , ^ ore y — 1 

positive roots of B(x). Hence for any poative value z ^ zi, ^ iCi , • • * , 
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t 


m 


^ tho polynomial ]J(a;) doea not vaniah. Thus R{xi) and therefore abo 
A* and A are not equal to zoro. 

Let Ufl denote by Z* the random variable which wo get from Z' by a small 
displocomcnt of the ]?oints a;i , • • • , into a system of noighboiing points 
% I * ' * I 1 that the moment of order u of Z* ^ibout the origin bdcomes 
equal to (y ^ 2, • - . , j). By choosing c small enough we con obtain 
the values iEi > • • < , Jii as near to a > ■ ■ • > 3? ; as wo like, In particular, e can be 
chosen so small that £i , • • • , are poaitivo numbers less than i, and > ci 
OT < (i accordingly fts kj > or < d. Then Z* is obviovwly an element of 
Q(fe, f). But for Z* 

P(Z* < d) = P(Z' < d) « P(Z < d) - 6 « a(d, kj) « a 

holds true, which is a contradiction because a(d) h i) is the limes inferior of 
P(Y < d) formed for all random variables 7 contained in Q{kf i). Hence our 
assumption that thorn exist j different positivo numbers tri , « • * , ic/ , for which 

^ t and p{X{) > 0 (i » 1» 2^ * • • , j*), cannot be true, and the propo- 
sition II is piwcd in all its parts. 

It follows from the proposition II that a(d, ft, 1 ) is indopendent of k On 
account of this faot and of the fact that any random variable X oan be arbi- 
trarily well approximated by arithmetic random variables, we get the prop- ’ 
osition: 

III. Let us denote by M4, , * • « , die nMnnefUs about the ongtn 0 / order 
ii ; • • • , i/ 0 / a certain nm-noQQlm randma variable. Denote by fi(t) the set 
qf all non-neyotive Uimiied ro/ndom oarfablse, for which the t|4h moment about 
tftfi origin is eqml to Mi, {v = 1, • • • , j). Denote further by a{d, t) the limes 
. w^ferior 0 / the prohahililies P(Y < d) formed for all random varichlee Y con- 
tained in £1(0. Then we can sayi There mete in £2(0 a random Gamble Z for 
which P{Z < d) = a(df t), IfQ< a(d, 0 < 1 Z is a fandom variable for 
which P{Z < d) a(d, Oj ih&ro exiH at mod j — 1 differerU positive numbers 
Xii *** , , mch tftat Xi 9 ^ dfXt 7 ^ t, and tfte probabilUy that Z ^ Xtf is posi- 

tive (f = Ij 2, * • • , j 1) 

It is obvious that a(d, t) decreases monotonically with increasing t. Hence 
lioi a(d, 0 exists and it can be easily shown that: 

t -<0 

a(d, 0 eonoef|;es toioarda 00 . 

3. Solution of the Problem if Only Two Moments are Given# Let us denote 
. by Mr and Ma tho absolute moments respectively of order r and e about the 
^ point (Co of a certain random voiiablo 2, where r and e (r < e) denote any 
integers. 

Let us first consider the case 


It follo^ from (1) that 


M,. 
^ - d} 
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Af . M 

We shall show that Fot this purpose let us coneidfir 

the arithmetio random variable Yt of degree 3 defined as follows: 

p(aJo) = 1 “ p(ao + d), ^ p{^ + d + &) 

where c is a positive number and p(u) denotes the probability for Fa = it, 
The r-th moment about o;^ of Fb is obviously equal to Mr . On account of (a) 
the a^th moment of Yh about xn is less than or equal to Af j for h - 0, On the 
other hand the a^th moment of 7b about xn will be greater than if b is sufii- 
oiently large. Hence there exists a non^negative value bo such that the a-th 
mom^t of 7bo is equal to M. , 

8 m»r(-d<)'H-,<*. 1-^+1 

and since € can be chosen arbitrarily smalli we have 


Af 

If ~ > 1, then Oi is equal to zero, because Od decreases monotonipally with 

decreasing d and Od » 0 for d ^ "s/lir • 

We have now to oonsideT the ease 


(fi) 

First we shall show that 


M. 
^ d* 


(3) 



U ' /M \- M M, 

In fact, if ^ were > 1, then making use of (p) we have ( V 

■ » 

and lienoe (ATr)^ > M. , But this is not possible, because according to the 

I 

well-known inequalities between moments, (ilfr)' ie less than or equal to Mt < 
It Mows from (3) and (p) that 


(4) 


^■<1 

d- 


In order to calculate Od j we shall apply the propositions found in section 2, 
On account of the propoatioh 1, Od is equal to the limes inferior of P{y < d) 
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whore < d) is formed for all nou-negative random variablea Y fot which 
the r-tb moment about the origin is equal to Mr and the s-th moment about the 
origin is equal to AT. . Hence we can restiiot ourselves to the consideration of 
non-'oegative random variables and of the moments about the origin. 

We diall show that 0 < a(d, t) holds for any positive value U In order to 
prove thie» it is sufficient to show that Od > 0 since a(d» t) > Oi, It follows 

from the inequality (1) that (Ki > 1 - Since, according to (3), ^ < 1, 

we have Od > 0, and th^efore also 

(6) a(d, /) > 0 


Let us see whether a(d, t) < L If Mt = then, as is wcU.-knowii, only 
a sin^e non-negative random variable Z exists for which the r-th moment 

t 

about the origin is equal to and the s-th moment is equal to (Afr)^, namely 
the arithmetic random variable X of degree 1 for which the probability that 
X « ifl equal to 1. Since < d, as con be seen from (3), we have 
P(X < d) »= and therefore Od ^ 1. Hence in this case our problem is 
already solved and we have to oonaider only the alternative: 


(0) JIf,* Af; + <;^(<r*>0) 

We shall show that a(d, 0 < 1 for * > + dr . For this purpose let us . 

consider the non-negative arithmetic random variable Fc of the degree 3 defined 
as follows; 

vi'^Mr) « 1 — «i p(0 ^ ^ s ^ * 

where p(i() denotes the probability for F« n tt, and c is a positive number < 1. 
The r-th moment of is equal to 

ilrPiVW,) + fp(0 - Afr. 

The ^th moment of F^ is given, by the expression 

A = tApiViSf) ■+ <•?(*) =. (1 - OMf + tt* ^ . 

F 

On account of (6), i U less than itT. for < > 0. For a ■ 1 wo have 

A - r'Mt > i-'Mr . 

Since from > JIf. , we have A > J/. for * - 1. ' Hence there oxiata 

a positive value o < 1 for which A => Jif, . Thus the j^th moment of is 
equal to Mr and the «-tb moment of Ft, is equal to Af. . We have 
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P{Y„ < <0 = p( 0 ) + p('C^ = t- «y + !- « = !- « y'<l. 

Henod 


( 7 ) a{dy t) < h 

On account of (5) and (7) it follows from proposition III, that there exists a 
non-negative arithmetic random variable X belonging to the set £2(0 such that 
P(X < d) = a{dt i) and there exists at .moat one positive value 
with positive probability. Hence a(d, i) is equal to the Imes inferior of tho 
probabilities P(Y < d) formed for all non-negative arithmetic random variables 
Y which have the following two properties; 

(1) The f-th moment about the origiii is equal to Mr and the s-th moment 
about the origin is equal to M, 

(2) There exists at most a sinjdo positive value d(^.d, with positive 
probability. 

Denote by 2 a non-negative t-limited random variable with the properties 
(1), (2), and for which P(Z < d) a(d, i). The following equations hold 

p(0) + p(d) + p(d) + p(i) = 1 

(8) p(s)r + p(dK + pWf' = Mr 

p(S)e + P(d)d* + p{{)t * M, 


where p(u) denotes the piobabSity that Z ^ u. 
From the last two equations of (8), we get 


(9) 

( 10 ) 


p(i) 


-M,+ p(f) - fdn 
- 4") 



M. - r’Mr + pit) [fir - n 
(f (d‘-f - i*'') 


I 


gjnee — > ~ and f > rf, the numerator in (0) fe posifave. Sinoe 0 ^ p(4) < 1, 
w d* 

the inequality 


(11) 0 < 4 < d 
must hold. H^oe 

(12) p(«) > 0. 

■We shaa show that p(t) = 0 il t ie suffidently Iwge. For this purpose let 
us make the aseumption p{t) > 0. We define a new random variable Z' as 
follows: 


p'(t) B p(0 - « where 0 < t < p(0 
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and 


p'(rf) a p(d) 


et-' ~ i' 

* — J*”') 


p'W =>= pC®) - 


aft* - 

J*-rJ 


p'(0) = 1 - p'(i) -- p'(d)4)'ft) 


p'(«) =a 0 for all values a 5^ 0i 5^4, 
p'(u) denotes'the probability that 5' » u. 

The equations (d) remain satisfied if we substiltute p'(0), p'(4), p'((0>,aad 
p'ft) foT p(0), p(4), p(d), and pft) lespeotively, Henoe the r-tb moment of %• 
is equal to Mf and the s-ih moment is equal to Jlf« , We have to show that Z' 
is in faot a random variable, that is to say, that tlia d^ed probabilities are 
>0 and ^1. It Is Bufiloient to show that the defined probabilities are non- 
ne(^tive, because the sum (tf them is equal to 1 and therefore they must be <1. 

Obviously p'(f) is >0. Since t > d and acoording to (11) d > 4, we have 
p'(d) > p(i) > 0. Aocor<fing to (12), p(4) is poative. Hence for « suffirfenlly 
smail p'(4) is also positive. We have to show that also p'(0) > 0. p'(0) is 
given by ■ ' 


p'(0) - 1 - p'(4) - p'(d) - p'(i) 

« 1 -- p(4) -- p(d) - p(0 + 1 [l + 

.... mr - ro + f (<r ~ 4*) - m - n 


r(d^-r ^ ^-1*) J 


Bines V(^) > 0, c > 0, ({ > 6 and s > rp tfiis last expL>eSBioii is positive it t ia 
suffitnently large. We may asaume t so great that p'(0) ^ 0, hacaiiae we want ‘ 
to calculate only 


Od » lim a(d, j). 

I-*** 


Now we shall show that 


P'(d) + p'(f> > m + Pft)- 


P'(d) + m " P(d) - pft) 


0= < 


0 C 


r e-fiT ' ,■] 
yiSr* 4'-0 " J 

U d-^ - 4*'' ~ M ^ 


Inf&ot 
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Tlien 


p'(0) + p'(i) < p(0) + p(«) = aid, 0 


roust follow. SinGO p'(0) + j/(i) = P{Z' < d), we have a contradiotion and 
therefore the aasumption p(() > 0 la reduced to an absurdity. Hence p(i) 
must be equal to aero and a(d, t) » oj . If we substitute aero for p(<) in (8), 
(9)i and (10) we obtain: 


(13) 

(14) 

( 16 ) 


p(0) + pis) + p(d) = 1 
^ p(S)e' + p(d)(i' = Mr 

XSW + = M. 



- Mr 
(ridf-r - «i-r) 



M, - MrT’ 

d'id'-' - «*-’■) ■ 


We shall prove that p(0) => 0. For this purpose let us make the assumption 
p(0) > 0. Denote by Si a positive number <S and let us consider the arith- 
metic random variable Z' of degree 3 defined aa follows: 



- Af, 

iKd*" - «"') 



M, - MrSr 
li'id'-' - «n 


p'(0) = 1 - p'(ii) - p'(d). 


The r-th moment of Z' is evidently equal to M, and the s-th moment to Afi . 
Since p(5) > 0 according to (12), and p(0) > 0 by hypothesle, p'(0) and p'(8i) 
will be greater than aero if $i is eufficiently near to i. The derivative of p'(<Q 
with respect to ii is given by 

1 - ■af,(s - r)sr'-\il-' - sn + (>- r)sr'-\M, - MrSj-l 
^ id'-'-sn* 

* - (if, _ Mid'"'). 

(r(d-'-8n’ 

gj|iuj 5 ^ the above expression is negative. Hence p'(d) decreases 

with increasing St . Since St < S, we have 

P'{d) > p(ti) > 0 


and therefore 
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1 - j)'(d) < 1 - p(d) = Oif . 

Since 1 - p'((2) ^ P(Z' < d), we have a contradiction and the assumption 
p(0) > 0 is proved an ahemdity. Hence p(0) « 0, and p(i) + p(d) » 1, 
{13), (14) and (16) wo have 


Hcneo 

(16) 


Af-d* - Jtf/ + Mji' - JIfrS* . , 
g(S) + p(d) = * 1- 

~ + «*(d' - Jlfr) » a 


The equation (18) in 6 haa at most two poaitivo roots, because the derivative 
of the left hand side of (10) 

r9^\U» -<0 + 


has exactly otic positive root in S, Since S ^ dis a root of (16)j the value of S 
which we are seeking must be the second positive root of (16), which we shall 
denote by $o • 

It can be easily shown that So ^ ^Q'etf for 5 3 = 0 the left 

hand side of (16) is positive on account of the assumption (fi) and for 8 ^ \/Wr 
it becomes equal to 

M,(M, - d-) ~ M;(M, - tf) = (k. - - (T) 

Since and tecolliag from (8) that Kr < d', the above expreaaion is 

teas than or.eqoad to 0. Hence it lies between. 0 and ■^(/Wr < d. 

Hence ot ia given by the expreamon 



Od = i - p((i) « 1 - 


M, ~ MrtS-' 
d^iiT - O ' 


For a =» 2r the root So can be easQy coloulat^. We get 






Mfr — d^Mr 
Mr-(f 


If we aubatitute in 
' we get 


Oi 



(17) ir for e and the right bond aide of (18) for , then 

4'T7^) 

^ , (M, - dnMtr - MriMtf ~ d^M,) 

™ (f) Affc + Af.d'l 

<r(jif; ^ litr) 

“ ' d'[2M,d' - (pf - Mirl 
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liot UB doRots the non-negative numbor M%j. — JIf J by o’*, then we obtain^ 

3 


( 10 ) 


fld *= 1 — 


(T 


(<r* = Mi, - Mj). 


Let U8 compare the "sharp" limit gjvea by mtU the limit giveii by (2). I( 
we Bubfltitute, in (2), 2r for a and d for ii/Mr we have 



RB a lower limit of the probability P("({ < X < < d). We see that lor 

small values of bd is considerably smaller than Od . 

Our results may bo summarized in the following 

Theorem; Demk by Mr the r^-th and by Ma the s-ik ahsolute moment of a 
random variable X about the point xo , wheD'e r < s. For my poBtiive value i 
denote by P(-ii < X <xo <d)ihe pr^dbiliiy /ftoi | Z - Jo | < d. The 
lower limit Oi of P{—d < X < d) m defined as the limes inferior of the 
prdbabiliiiea P(-d < — To < d) formed for all random variables Y for which 

the Trih moment about Xo is e^al to Mr and the a~th moment about is egud to 
Mg . We have to distinguish two cases, 


I. ^ In (kis cose Od = I - ^ < l.ondOd = 0 > 1. 


(17) 


„ _M,- MrUT' 

_ H-rl 


where to is the positive root f^d of the equation’ in i 

jlf;d‘ - - d*) + i'(d’ - Mr) = 0. 

For « = 2r we have 


. ;/M,r - (i'Afr 


we substitute in (17) 2r lor a and the above expression for , we obtain 

2 

IT 

Orf = 1 “ 


(d' - MrY + 


where v* « Jlfgr — Mt . 


CoWLBB CoMUISBION, COLORADO SpRlNGS. 


1 The oaBB s » 2r hsB bwn tTeoted alflo by G&ntelll. Hb demonstTftted the formula (10) 
in Quite another way, whloh cannot bo goneralized for the obbo s p* 2r. Cantolll's formula 
and its domonetration are given in the book of M, Freehot, f7enerah'Kcs «ur iVohsbilt'fies. 
yanaUer Alsaloires, Paris, 1037, pp« 12S-126i 
s Ab has been shown, there oxiets exactly one iiositivo root d of the equation oon- 
Mdered 



A MODIFICATION OF BAYBS' PROBLEM 


By R, V. Miseb 

Tho classical Bayes problem can bo stated os follows. We consider an um 
which contains white and black balls (or balls designated by 0 and 1). The 
probability p for drawing a block ball is unknown. But there is given a proba< 
bility function representing tho a priori probability for the inequality 
pi X, Wo draw n times from the urn (returning each time tho extracted ball) 
and got a black ball m times and a white one n m times. Now, after this 
experiment, we ask for the a posteriori probability Pii(ie) for the relation p ^ 2 , 
The solution proposed by Bayes can be written in a slightly generalised form: 

(I) P„(®)^lc{ip"(l-p)*'"'dF(p), 

whera K is a constant to be found by moans of the condition 

(10 m - 1 . 

We are interested in the behaviour of P,(!)!] if n tends to » under the condition 



11 ^ 

llm — *• a. 

% 


Laplace found in tho case of a priori equipartition F(x) >■ x, and I proved iu 
for any derivable F(x), that Pn(a!} tendh to a normal distribution: 



with tt = Hn(a: - Ae) 


(4) 




1' ^ a(l ^ a) 

Sfll " # 


It is easily seen from (8) and (4) that 
(6) Urn Pn{x) = 

ll^«» [I 


if iu < a 
** IT > a. 


Let us now oonaidor a slightly modified Form of the pi'obletiu^ 


Instead of otie 


1 Z^Uehrifli vol. 4 (1010) p. 00. CF. my textbook WahneheiidUkkeUB’ 

recAnunp und I'ftre Wien-Leipeig lOSL p. IfiS. Lnter I proved the Laplaoe- 

Beyee theorem for a moro general elaae of ; MonQkhcfi^ f&r Mc^thmalih und 
vol. 4S(lW)pp. 105-128. 

‘ This modifl^ problem haa boon treated by S. Bochnerj Antuifa o/ Huih,, VqL 1030, 
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urn we suppose there are pven n urns each conttumng white and black balls. 
The probability p, for drawing a black ball from the urn le unknown, but is 
Bubjeot to an a pnoii probability function F(x) which fumlshes the a priori 
probability for the relation p, g x, independently of v, We assume that on 
drawing one ball from every um a blaok ball appears m times and a white ball 
n - m times. Putting 

I 

/«\ pi + P« + ' • ' + pH _ _ 

W =Pi 


we ask for the a posteriori probability Pn(x) for the relation p ^ ®. 
The Bayea formula (1) must now bo replaced by 


(7) 


P,(x) j j j PtP' • • • P"(l - P«i+i)(l - pn+e) 

I 

■ " (1 — pii) ^ * » df (Pn) 




where is a constant determined by (1'). It is veiy easy to examine the 
asymptotic oharaoter of (7). We shall prove the following 
Thbohem ! // the fint three moments of ike a priori dMlrniion F(x) 


(8) f !tfdF(4!), r- 1,2,3 

exist and if the dispersion ba — bj ts different from 0, the a posteriori probiAUiiy 
Pf^{x) tends for w ^ « under the condiUon (2) to the normal disirihution (3) f«W 


w 




1 1 r j_ n j\ 

h; •* 


(ft, - i,)(l - ftl) - (ftl - 


■ ftl) — (ftl — ft,)' 

- 6 i)> J' 


2r„ "L ft! 

I 

In order to prove the theorem we write 
^ Vy{p,) == r / (!b), if v = 1, 2, * • - m 

Ol Jo 

s r^-L^ [ (1 " «)dF(aj), if I* = m + 1, m + 2, • • • tt. 
1 - Oi Jo 


( 10 ) 


Then formula (7) becomes 

(11) P»(*) - C /* J j dV,(pi) dVt(pt) ’• • • <i7,(p,)- 

Pi+)‘i+* * ’ 1 >*S** 

Each V,(pp) is a distribution function, i.e. a non-decreasing function with 
y,(_ ») 0, y.(«©) = 1. Therefore the conetaat C in (11) ia equal to 1 and 
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the integral repreaents the distribution funotion for the arithmetioal mean 
(pi + Pb + • • • According to the Cefniral Limit Theorem of the theory 

of probability Pn(x) will converge towards a normal distribution when oertaiii 
conditions are satisfied. In every' cafie, if Oi. ^ denote the mean value and the 
dispersion associated with Vy(x), then the mean value An and the dispersion 
asaodated with P^ix) will be defined by 

(12) si = 

n K-i n r-i 


We find from (10) 



(14) 


a, ss f xdVy(x) * r f x*dF(x) e= if v 1, 2j » • ’ nt 
jo 01 jo Di 

=> T—x f 3j(l ^ x)dF = ^ if r = in + 1, » 

1 — oi jo 1 - 0i ■ 

sj - r n^dVAsf) - ft! « -5, if . =. 1, 2, . . . ffl 

jo 0 \ Oj 


_ ba — bi {b| — hif 
" 1 " bi ^ 


if 1' = m + 1, 


* ft* 


We supposed the disperdon of F[x) to be different from zero. It follows that 
(IB) bi ^ 0, 1 - bi 0,b,bi - bS 0, (ba - b,){l » bi) - (bi - bi)Vo. 


For bi = 0 would imply that dP(a!) = 0 for all ai > 0 and 1 - bi = 0 that dF{x) 

- 0 for all tc < 1; in both oases the dispersion would be 20ro* On the other 
hand, it is easily seen that the relation btbi - bi 0 is not compatible with the 
condition of a non-vanishing a priori dispersion, and that the same is true for 
the relation (ba ~ bj)(l - 6i) ~ (bi - bs)® * 0. 

The total disperaon Ss! is equal to the sum of m times the value (birbi - bj)/bi 
and ft - TO times the value [(ba - ba)(l - bi) - (bi - ba)V(l - W** 

Thus we see tfiat under the condition (2) the sum tends to qd , while the 
ratio tends to zero, if n increases infinitely. These are sufficient oonditions 

for the validity of the Central Limit Theorem.’ The values given for An an^ 
B\ m (0) follow from (12), (IS), (14) and the well known relation 2HniSl![ — ^ 

8. Boifiiner in his previously quoted paper found, in a more complicated man- 
ner, the value of An and only showed that Pn{x) tends to zero if x < An and to 
1 if s > An. 

Exajuplbs. If we assume the a priori probability to be miifortn, i.e. F(x) - rr, 
we have 

bi = i, 6a = }, 6i == i 

and therefore from (9) 

* Of. H. Crombri Random Varialle^ and ProhokiHiy Distributienst CsmbridKe Tract in 
Maihsmstioa and Maihematiod Fbysiosj No. 3Q| 1037, p. 60. 
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■An “ 4(a + 1), 


1 

an 


18n’ 


A more general ease ia that of a more ooncentrated a priori probabiUty funo- 
don 


nz) = Ca*(l - *)', C 


Hero 'ire find 


hi 


ft + 1 


hi 


H” 1 + 1)1 

nsni 

(Jt + l){fc •4" 2) 


t+Z + 2’ (fc + 'l'+27(*! + i + 3)' 




(jfc + i)(ft -I- 2)(ib + 3) 

(fc + 1 + 2)(fc + 1 + 3 )(fc + 1 + 4) 


and the values of A, and H\ are 
A _ ® ”4" h "i- 1 

fc + I + 8' 


1 a{I-fc) + (fc + l)(l + 2) 

i “ 


2Hl n(fc + I + a)‘(*! + i + 4) • 
By ititcoducing the moments of F{^) relative to the mean velud^ 1.6* 

B> = j (* - 6i)*dP = hi - b!, 

B, = ( (* “ - bi - 3bi6i + 26} 

are can transform the general formulae (0) into 


(le) 


fii 


(17) 


^ 1 r D I D ot^hi ds bi + a(l “ 26 i)T 

i!a-v J- 


The first of these equations shows that the a posteriori maan value An (for 
ell n) ia equal to the a priori mean value bi ^ if the experimental mean m/n or a 
eomcidea with the latter. On the other hand, in the oose of a symmetria a priori 
distribution (bi — if = 0) the second equation is reduced to 

1 1 


2H\ 


= i(fl,-4Bj). 


n 


On the whole it is remarkable that the influence of the a priori probability does 
not vanish for n in the case of our modified Bayes problem/ The ex- 
planation of this fact is to be found in a more generalized theory of the inverse 
problems in probability* 

UNivaBaiTT or Istahsoiti Tnaxirr. 


* Of. my papers quoted in footnote 1, 


ON THE PROBABILITY THEORY OF ARBITRARILY LINKED EVENTS 

Bt Hiu>a QsnaDGBii 

1. latroilttctlon. The classloal Poisson problem can be stated os follows: 
Lot pi , Pi I • • • Ph be the probabilities of n twispendenf events 
re^cdvely; i.e. the probability of the Mmultaneous occurrence of Ei and B) 
is equal to jhp) , that (tf Ei , E/ , E* is.equal to pipipt' and so on. We seek the 
probability P,(x) that x of the evmits shall occur. If , pi •> pt a ... a 
the problem is known os the BemouUl problem. 

More generally the n events may be regonled as dependent, Let pt) be the 
probability of the simoltaneouB occurrence of Mt and E/) pt/t that of Ei, E/, En 
and finally pu...! that of Ej , E| , • ■ • Er. There sliMl arise again the problem 
of deterimning the probability Pa(!i;) l^at x of the n events will take jdace,' 
Furthermoro the osymptotio behaviour of ?r(x) for large n can be studied; and 
we shall especially be interested in the problem of the convergence of P„{») 
towards a normal distribution or a Poisson distribution. 

Even in the general case which we just explained, the sums 

n ti 

S| = S Pi, Sl = S PUl Sr « Ptt...# 
i'l frM 

of our probabifities differ only by constant factors from the faeioml moments 
Jlf!;” . . . M of P,(s). For we have 

S, = = Jj t x(x - 1) . . . (x ~ r + l)Pn(*). 

Starting from this remark the author has, in earlier papers, [S, 9j lOj established 
a theory of the asymptotic behaviour of P»{»), making use of the theory of 
moments. The criterbn for the convergence of Pr(x) towards the noimol-^r 
the Poisson'-ifistributibn oonsiatB of certain conations' whidi the 8, must ' 
satisfy. 

In the following section a concise statement, of the whole problem be 
^veu, independently of tiie author'a earlier publications, For the convergmico 
towards the nornud distribution we shall be able to establish a theorem under 

a 

wider conditions in a manner which seems to be simpler, Finally, some appli- 
cations of the theory will be oon^dered. 

> Soc, for infltsneQ; reforenoeg [1H7J at end of paper, 

* U^ng the ''theoi^m of the continuity of mojnentsj^' Frofeeaor v, Mieoe |11] establishfid 
ftumeiont eondittodB for the convergence of Pa(«) towards a iPolemn dietribution in the 
case of the problem of "iteratione.*' However, hia reasoDing can be applied to the general 
fiaao without much difficulty. 
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2. Formulatloa of the problem. Lot us consider the n^imonsional coUccHve 
(Kollectiv) consisting of a sequence of any n trials. In the simplest case these 
trials will be oKemaKses, i.e. for every trial there will exist only two resultSj 
which we may denote by “occurrence/’ “non-occurrence” or by “1/' “0.” The 
single trial may eventually be composed in various manners* For instance 
we may draw m > n times from an urn, which contains counters, bearing in 
arbitrary proportions numbers from 0 to 0. The first “oVent” Ei may consist 
of the fact that the first three extracted counters bear even numbers; the second 
trial Ei will be regarded as suocessfulj if the sum of the counters extracted at 
the secondi third and fourth drawings is greater than five, etc. In every case 
the re^t of the n trials will be expressed by n numbers, each of them equal to 
0 or 1. The result (1, 1, 0, 0, 0, • * • 1), for instance, means that the first, the 
second, and the last trial were successful, the third, fourth, • * • unsuccessful, 
and we have an arithmetical probability distribution v(aci , ac* , • * • (»* = 0» li 

ft =3 1, 2, ■ * • n), where 

(1) S ' * ■ £ ®(®i, * ■ * iCii) = 1. 

Xu 

' Instead of the 2” - 1 values of v wc will deal with certain groups of partial 
auma of them; the first is 

2 • • • 2 »(®l , »g , • ■ • I 1» •••»«)“ Pi (» * 1, 2, • • • ft) 

where is the probability that the t-th trial will be successful. In an analogous 
manner let pa be the probability that the irih. and the j-th trial are both sucess- 
tul, puk tbs probability that the i-th, ;-th and ft-th trials are simultaneously 
.suco^ul. Let UB provisionally denote by an (n — l)**tuple sum over all 
variables, except X( , by an (w - 2)-tupl0 sum over all variables except xi 
and etc. We shcdl then have; 

pi ^ s(»ri , ' ' * , 1, iTj+i , ' * ■ ®b) 

Pa “ £ i j , • • 'X/- 1 , 1, , ■ ■ ■ ®ii) 

( 2 ) 

|f|fl«ltBfllVI» 


P11...I. = tf(l, 1, • • ■ 1). 

In the Mowing these probabilities pi , pt/ , pi;* • • • will be assumed as direcU]/ 
gimii There are 



values of this kind and it is easily seen, that the partial aums (2) arc liiieatly 
independent. 

If, especially, the probability v(xi , *> , - • Xn) dependa only on the number 
of zeros amongst xl , , * < • aiii , i.e. if 
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v(l, 0, . . • 0) « »(0, 1, 0, ■ • • 0) = • • • = »(0, 0, ... 1) 
vdf If • ■ . 0) ^ v(lf 0, 1, • . • 0) = . * ■ = v(0f 0, • » • 0| 1| 1) 


the value of pt is independent of i, the value of pt^ mdopendent of % and i, 
and ao on; 

Pi B3 Pa « Pr 


Pm Pa • =5 Pn-i,i* 


In the particular oaae of ind^mdenl events we have only to deal with n 
probabilities, namely pi , pa , • . • pu * We have indeed p</ =? ; p^/fc sa 

V<P^Ph ' • • Pa—w “ PiP* • * • Pr * 

In the case of chainB however, we need only know (2n — 1) values, namely 
Pi I pi 3 PnlPatpti, ••• Pii-4.i». The other pu, and the p^k, •.* pa...* 
can be expressed in terms of the above probabilities. 

Beturning now to the general case it is easily seen that in the expression for 
Pn{s) the pi I pn will appear only in the following combinations 


(3) SS) - 1, S.(l) - ‘if Pt, 


I.IM* 

Sn(S) * 2 P«» • • • A(n) = PM..... 
w 


Indeed, at the basis of the solution of the ''problem of sums/' there are the 
following relations [11] between the Sn(») and the PnC^c). 




^ 0, • * * nV 

s t>r 0, . * * a/ 


The linear equations (4) may be solved (by reourrenoe) for the PnC^c) and we 
find the important result that 



PM = E 

\w/ 


Let be the factorial momeTit of ■PR(aOi 

(0) Mi*’ = LajOr ^ 1) • Op - + l)P,tOr). 


Making use of (4) and (6) we obtain 

(7) Mi*’ - 0lS,(s). 

Our aim is to obtain mformation eonceniing the asymptotic behaviour of ?»((() 
by studying that of the moments of Pn(^). The moments however are easily 
seen to be ^ven in terms of the 


3. The asymptotic behavlcr of ?n(x). Convergence towards the normal dis- 
trlbutioii. 

a. Tax Pbincipal Thbobdh. According as the mean value 
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( 8 ) = 

remaiziB bounded or not for indefinitely increasing n, there arc two types of 
posaage to a limit. In the first cose the distributiott will converge (under certain 
. eonditioiis) towards a Poisson distribution; in the second case it will approach 
(under certain, conditions) a normal distribution. Aa regards the convergence 
toworda the Poisaoiv diattibution the author has published [9) a sufficient 
condition which seems to be (][uite simple and general. Wo shall^ however, not 
resume this problem in the present paper. 

We propose, indeed, to prove in the following pages a new theorem concerning 
the convergence of 

YM = £p„tO 

towards a nomal distribuUon. 

Por this purpose we introduce the following function of the discontinuous 
variable e « 0, 1, 2, . • * ti 


(9) 




g+llSTnCg+l) 

a* iSrt(a) 


a 1 S 

or, more oonoisely written j, ■ — where Sn(e) is defined by (3). Put- 

Cl 

ting z = Ofttc, let us consider 


(W) = hn(u) 

where u is regarded os a coniimms variable in the interval from 0 to c. (< > 0.) 
Denoting the variance of for by Ms » sX we shall prove the 
Theobbm: Leithefunciionhn{u)i definsdby (10) satisfy the foUowing eonditiomx 

(i) If n is si^idenSy large, h(u) admiie derivatives of every order in the interval 

(0, i) 

(ii) Atu^O, thefir^ derivaim of hn{u) has a IM, /orn -> «, whidi is differm 
from —1. 

(iii) // u is in fAe interval (0, c) ike k4h derivaim qf k»(u) remains, for every k, 
if^moT to a hound Nu ti’hich is independent c|f n. 

Then 

(11) lim 7n((in + PuVs) *= 4= I 

«-►» •y ?r 

We shall see tliat'in many applications these conditions may reasonably be 
assumed as satisfied, 
b. Dbmonstration ov ‘Thb Theorem. 

In order to prove the principal theorem, stated above, we shall at first deduce 
some properties of the (finite) differences of {s = 0, 1, ■ • •) from the assump- 
tions (i), (ii), (iii) which deal with the derivatives of An(u). Indeed, the *c-tli 
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difference of* qJiz) with respect to «, (which contains the values of for 
i? ^ 0, 1, '**«), differs only by the factor a. from the «^th divided difference of 
with respect to u (which is formed by the values of An(u) for u ^ 0, 
1 n 

— , • • * ^ * Let n > X and so large that x/on < s; then all t^’Values used in 

0* an 

the formation of tl>c l^th divided difference of iiA(u) will be in the interval (0, &), 
Now, as it U well known, the absolute value of any divided difference of order k 
can not be larger than the largest derivative in an interval which contains all 
tho abscissae, used in the formation of the divided difference. But according 
to hypothesis (iff) the x-tb derivatives of hnCu) in (0, c) are all inferior to Nm . 
Thertfore* we have 

(12) ( aiA^g^fy) 1 < AT, . 

and f of every y > 0 

(13) lim a!r^ A* gnU) = 0. 

n-*« 


On th« other hand from condition (U) it follows, oa is easily seen, that 
(14) lim «, A <= aiil 9 «(l} - ^.(0)1 » c ?* ~i. 

iix»fla cm|> 

The equations (13) and (14) imply but fimie differences qf gniz)^ 

Let us now introduce certain new moments Fr which we could call "factorial 
moments about the mean." They are indeed related to tho factorial momenta 
in exactly the same way as the moments about the mean are related 
to the moments Ml about the origin. Writing, & , a and ga instead of iSs( 2 ), 
o^andgA(s),VeBet 


( 16 ) 


n « A*; (Jlf^'^a''-) « JlfW - + ( y ± a* 




P* =a 1, Pi = 0. 


gxO 

where, particularly, 

(16) 

From (IB) we have: 

« P, + »<P,„ia + f g) 

Let iis begin- by proving the following 


■ db o' . 


m 


+ 




Fia^ + o' 


’ If we only want to deduee (18) it )« Buffioient to Buppaac thnt iV* (without being inde- 
pendent of ») inoreBees more alowly than any power of o» . 
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Lemma I; It folhm prom (13) and (14) thA itw hm /or the F, defiled by (15) 
(18) 

n-*m \1 • 3 ' • • ^ l)o*' if V even, 

First we conclude from (16) and (14) that (18) ie true for v «= 1 and v = 2. 
In order to prove (18) for mry we shall pmnt out, that 

(v « 2, 3,."0 


(19) 

lim = 0- - l)c lim fri- 

Setting 


(20) 

gt — I and till « ~ at 

a* 

we get 


(21) 

^ ^ 

m. 

and 


(22) 

Afflfsa flVA 

A'm, = A'“*(«vr^ 


a* 


A'mp * 
i-D or 


{* = 0,1,2,..0 

m, = u' 

But according to (16) we have 

(28) 
and therefore 

(24) ^ - «*'Ap(W.) - 

(a + TS Sr-1), 

Here we have made use of the faot that the l^-th difference of a product uu can 
be transformed in a finite sum where a and p ore non-negative integers 

and (X ^ K, 0 g K. ^If we concern ourselves with derivatives and not with finite 
differences, we have, a + p = *r and Sa^ =* . Suppose 

ff + jS > — 1- 

Then j8 ^ v - therefore,, as y > a we have jS > — Since 

the product con»erflea toisord aero, in accordance with (13), whereas the 

#"0 

F 

factor j 3^ -n remainc bounded for every a <v. Now suppose 
a* 
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a + =» j' — 1. 


Then ^ s= v — 1 — a. First Jet a < j» — 2; then = — ot> . 

JU 

Thus converges again towards zero, whereas the other factors are 

*■0 

bounded as before, Next, if a « — 1, then p ®= 0 and A®/< =* /o =* 0. Thus 

(—0 

the corresponding terra, of our sum is equal to zero. Finally if a *= j» - 2, 
then I? = 1, and - 1. The corresponding term, of the sum (24) will be 




• lim a A /, = {v — l)c lim 

n-n# *“0 rt~*80 




which completes the proof of Lemma I. 

We shall now establish a relation between the factorial moments about the 
mean F, and the ordinary moments about the mean M, . To an expression 
of the form 

( 26 ) ca'Ftt 


(where the constant c is independent of n) let us attribute a “weight” p + 

« 

Then we shall prove the following lemma 
Lemma II: Lei v « 2fxiv even), v = 2p + 1 (»» odd) and 


(20) 

A 

“ (r - 2p)l 2''pl 

Then 


(2?) 

My — otfa^ Fy-ip 

p-O 


is equal to a fvniie sum of ferns of ike form (26), each of which has a weight less 
than j'/2. 

To prove this lemma we begin by expressing the M, in terms of the factorial 
moments We shall then express the ilf by the F, . Now, let Sn be 
the '^Stirling numbers of second kind,” i.e;, putting 

(28) =s a;(a; _ 1) . . . (x - g + 1 ) 
we have 

(29) /-L (i8 = 0.1,2, •■■) 

' K-O 

Then by an elementary calculation we obtain 

(30) M.= t Jkf'”'’ [»,. - + (j)®’*,-!,,-, - . • • ± (’)o'l. 

If we now introduce the F, we get 
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(31) 


(aX* r - a 0 * (0 


FUithermoTe we lu&y easily verify that 


(3a 




“I- 




+ 


1 


X 


(P-T-p) 


r / • 

But the «« for 2 = 0, 1, 2, * . • are equal to the values of a polyuomial in a, of 

2k 

• • • S*** 

degree 2k, the highest term of which is equal to , The degree of the product 

K\ Z* 


(33) ^ ^ ^(x) 

is therefore equal to (v — r - p) + 2p = v - r -h p. On the other hand the 
expression between brackets in the right hand member of (31) is nothing other 
than the r-th difference of f(x). (The missing terms of this difference are indeed 
equal to zero, the corresponding being equal to zero.) 


This v-th difference will certainly vanish if 


v — r + p < p i.e. r > p. 

Now, let r = p. Then the v-th difference, i.e. the coefficient a, of 
« in (31), is equal to p\ multiplied by the coefficient of in {p(x ): , 


, 1 1 

" (»/--2p)i2vr 

Pinally, let r < p. Then the weight of is inferior to v/2. We have thus 

established Lemma 11. 

We have for instance for v = 2, 3, 4, 6 

M\ = = 0, Mx *= J’j -f- 0, ilfj *= d" 32^8 d" ® 

= (F* + 6 oF* + 3 a*) d- 6 Fj d- (7Fj -f a) 

Mx = (Fb d- 10 Fafl) d- (10 F* d- 40 Fio -f 10 i) d- 25 Fj d* (16 Fa d- a) 

Inversely in an analogous manner, we can eiqjress Fy by the 


J^p(p = 1, 2, ‘ ■ j»). 

We can now terminate our demonstration by proving the followmg 
Lemma III: If the conditions (18) are satisfied, then 
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, . fO ■ ■ ■ y odd 

l'“Mf = ^’ = {l-3 ■••(.- l)... 

First the equation (18) for i' - 2 gives 


I' even, 


V Fz V ^ 

hm — = hm — — « c 


Ct 


thus 

(35) 




»-♦« Or 


=5 1 + C (C —1). 


It is therefore obviously sufficient to prove the relation 
(36) 




Putting = 2j« and j' “ 2jit + 1 respectively we obtain however from our 
lemma 

a*" p-a 

Here R represents a finite sum of terms of the form (25), of "weight" inferior 

to But by virtue of (18) such a term, divided by converges towards zero 
2 ^ 

and we obtain 


(37) 

For an odd 


Mf V' r Fr-io n 

lim -T~ = a- hm -r--- = 21/ 7 — nrrrs — i • 

n“»o8 ■ p—O n-+M pi«»0 \v ““ 2p)!2^pl 

f), Gr-zp is eqml to zero, for an even j»(«= 2p, say) however, we have 


and we obtain 



(2m - 2p)! 

2^'-p(m - p)l 


(38) 


C2m)! (2m--2p)1 

n-*« (2 m — 2p)12'’p! 2 '‘“<’(m — p)I 


_ (2m) I f' mI ^-p 
S^mI ^ pI(m ~ p)I 


Hzpil + c)'* 


in accordance with (36). Lemma III is therefore proved. 

Our* principal theorem is now an obvious consequence of the well known 
theorem of the continuity of moments. By virtue of this theorem the con- 
vergence of yn(Gn + ysns/^) towards a normal distribution as given by (7) 
will indeed be assured if the moments of F„ converge towards the moments of 
the corresponding normal distribution j.i.e, if (34) is true. Thus our principal 
theorem is completely dejnonstrated. i 
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4. Some applicatioiis. 

Example 1. We ahall consider the following play as a very simple appli- 
cation of our theorem: An urn contains m ^ 2n counters bearing the numbers 
1, 2, • ■ • m. We draw them, all, one after the other, without returning the 
counters previously drawn. We aahfor the probability P 2 n{x) that an even counter 
vnU appear at a drawing of even number x times (0 ^ i ^ n). 

As can be easily found, we have 

P2= Pi = “ • = ^ 


P 2 , 4 =P„= ... 

Consequently 

Q _ w p _ 1 2n — 2 ^ 1 (2n — 2)(2n — 4) 

" “ 2 ' “ V 2 / 4 2n - 1’ ® “ V3/ 8 (2n - l)(2tt - 2)' 

.(39) •••• 

a _ 1 /nN (2n — 2 ) (2n — 4) > ' • {2n — 22 -b 2) 

* “ 2' V 2 / (2n - l)(2n - 2) • • • (27i - 2 -|- 1) ’ 

From (39) it follows that 


(40) 




n — 2 2n — 22 
n 2n — 2 * 


Setting z/\n — u, we get 
(41) 


hniu) = 


i^-i) 


The conditions (i), (ii), (iii) of our principal theorem are obviously satisfied if 
« < 4 and we have 


hUO) = -I = c 


The probability defined above is thus seen to converge {according to (11)) towards a 
normal disiribviion, having a mean equal to ~ and a variance 

it O 


Example 2. Probability of an "occupation.” Let h stones be distributed 
by chance over n places.. Then the probability that any stone will occupy a 
certain place will be equal to l/n. We ask for the prohcdnlity Pn{x) that there 
shall he x places, every one of which is occupied by exactly m stones* 

By certain simple considerations, well known in combinatory calculus, 
we obtain: 


(42) 


k\ 

^ ^ iffilQii rn)\ 



* The problem prcaentB itself for instance if we eak for tha probability that in a oectain 
county there will be * villages, everyone of m inhabitants. 
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(43) 


s.- 


n! 


k\ 


t\{n - z) 1 (ml)*(fc - inz ) ! \n 
Let H/n « a. From (43) we deduce that 


-lY" 

ni 


?«(«) == 


W — 2 

n 


/, _ i±i' 

n 


. (-aj' 


kiiK+m 


(«) 


/ 2m\ ( 

V) 

h 

Now, let n and fc tend simultaneously to «, in eucA a way that « — ^ remains 
bounded. We get at first 

(46) 

*-♦«, n ml 

As 0 , is seen to be of the order of magnitude of n we introduce the new variables 


- =ss V and V = u 
n n 


We have then (writing h and h instead of hn and Tin) : 

* gM = TE(i;) 

E(w) = = A(u). 

Therefore 


i-i 


(«) 


These formulae show that the Ts-th derivative of h(v) with respect to v contains 
only rational esqoressions, [in the denominators of wMch there appear powers of 

(1 - »)], and poative powers of log Thei conditions (i) and (iii) 

of our principal theorem are therefore satined if « < 1. Furthermore we have 
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« - 1 - log (l - i) + ^ 


—m 


■(— i)-(— V) 


and consequently 


lim 




1 — “ — a + 2m 
a 

^ + — r-jm! 


] 


lim-" 


S C. 


We have thus obtained the interesting result that, 

The prdbaUUty Vn{x) thai x places at rnosi are ‘occupied, each one by m stones, 

converges towards a normal distribution if k and n tend timvlianeously (o in 

1c * 

such a way that lim - = a is bounded. We have then 

n-*®o n> 


( 48 ) 
iritb 

( 49 ) 


lim V,(o„ + 1(^2 »») = ^(») 


lim. 
»-»« n 


a 

m! ^ 


lim — - 

n-400 fln 




UKlVBIlSlTTr OP ISTANSmi, 

Istanbtjl, Ttokby. 
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FIDUCIAL DISTRIBUTIONS IN FIDUCIAL INFERENCE* 

By S. S. Wilks 


1, Intfoductioii, The essential idea involved in the method of argument 
how known as fiducial argument, at least in a very special case, seems to have 
been introduced into statistical literature by B. B. Wilson [1] in connection with 
the problem of inferrbg, from an observed relative frequency in a large sample, 
the true proportion or probability p associated with a given attribute. Since 
1930 the ideas and terminology surrounding the fiducial method have been 
developed by R. A. Fisher [2, 3], J. Neyman [4, 5] and others into a system 
for making inferences from a sample of observations about the values of param- 
eters which characterize the distribution of the hypothetical population 
from which the sample is assumed to have been drawn. The functional form 
of the population distribution law is assumed to be known The parame- 
ters may be means, a difference between means, variances, ranges, regression 
coefficients, probabilities or any other descriptive indices or combinations of 
indices which may be considered important in specifying the distribution 
function of a population. In arguing fiducially about the value of a parameter, 
a procedure applicable to tee of the simple cases begins by the calculation 
from the sample of an csftmofe of the parameter in question. The values of 
the estimate in repeated samples of the same size will theoretically cluster 
"near” the true value of the parameter according to a certain distribution law 
which can, in general, be deduced from the functional form of the population 
distribution law. If the distribution of the estimate involves only the one 
parameter, and if, as is frequently the case, one can find a function ^ of the 
estimate and the parameter which has a distribution not depending on the 
parameter, then one is ajole to set up, in a rather simple manner, fiducial limits 
or a confidence Merval for the parameter corresponding to the observed value 
of the estimate. The limits will depend on the particular method of calculating 
the estimate, the value of the estimate in the sample, and on the degree of risk 
of being wrong which one is willing to take in stating that the limits will include 
between them the value of the parameter for the population under consideration. 
In general the smaller the degree of risk, the wider apart will be the limits. 
Thus for a given pair of limits there will be an associated degree of uncertainty 
that the true value of the parameter is actually included between those limits. 
This uncertainty can be expressed by a probability a calculated from the 
sampling distribution of the ^ function of the parameter and estimate. Under 
certain conditions, one can, by simply changing variables, obtain from the ^ 

* An expository paper presented to the American Statistical Association on December 
28, 1937, at the invitation of the Program Committee. ’ 
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distribution what has been termed by Fisher a fidudd distrihution function of 
the parameter. From the fiducial distribution and for a given value of the 
estimate one can actually determine fiducial limits of the parameter corre- 
sponding to a ^ven risk a. It will be seen as we proceed that the fiducial 
distribution plays no indispensable part in fiducial inference; the i/r function 
and its distribution from which the fiducial distribution is derivable, are suffi- 
cient for the fiducial argument in many cases that commonly arise in statistics. 
We shall discuss fiducial argument and fiducial distributions from the point of 
view of functions. 

2. Example. To illustrate these points let us consider an example, namely, 
the problem of determining fiducial limits and the fiducial distribution of the 
range of a rectangular distribution for a given value of the range in a sample 
“randomly drawn” from it. 

If a sample of n individuals is drawn from a population whose distribution 
law is /(a?, d) = 1/0, where only values of x between 0 and O are considered, 
(that, is, a rectangular distribution having range 0) the- probability that the 
range r of the sample lies between r and r -f dr is ¥'(r, 0) dr, where 

( 1 ) = , 

Here 0 is the parameter under question, and r is the estimate; r is the difference 
between the largest and smallest variate in the sample. Thus, for a given 
value of 0, say 0a , ^(r, Oo) is a sampling distribution law defined for given 
values of r on the range r = 0, to r = 0o . If we let r/0 = yj/, then 

(2) <p{r, 0) dr = n(n - 1)(1 - G{^) d^, 

which, from a statistical point of view, shows that if we should take an aggre- 
gate of randomly drawn samples (of n items each) from rectangular populations 
and calculate for each mm^le-popiiMion comhination, then the distribution 
of ^ will be that given in (2). By a sampU-populaiion comhination m. this 
example we mean any rectangular population that may arise and a “randomly 
drawn” sample from it. The possible values of ^ range from 0 to 1. Thus if 
is such that 

(3) nin-1) i.e, - (» - D'/'J = a. 

and if we draw a sample of n from a rectangular population, we can claim that 
the probability is 1 — a that the produced by this sample-population com- 
bination will satisfy the inequality 

(4) 

It should be observed that there are many pairs of numbers, say and 
such that we can claim that , with probability 1 — a of being 
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correct ia making the claim. and are ordinarily , chosen so that the 
interval formed by them is as short as possible (or approximately so) in some 
sense. Inequality (4) is equivalent to each of the following inequalities 


( 6 ) 




^ >B>r. 
'pa 


Now \j/c can be determined from (3) when n and a are ^ven. For example, 
if a = .01 and w » 10, we find from (3) that = .496. For a given sample, 
the fiducial limits r/^'a and r oan be calculated from and the sample. It 
will be noticed that fiducial limits are nothing more nor less than random 
variables that fluctuate from sample to sample. The interval between r and . 
rfyj/a is called a confidence interval or fiducial interval] 1 ~ a is known as the 
confidJence coefiicier^ [4] associated with the limits. Hence, in repeated samples 
of n from a rectangular population with range , 100(1 — a) percent of the 
samples will produce fiducial limits r/^a and r which include the fixed value 6^ 
between them. This statement holds regardless of the value of da . Hence 
In an aggregate of sample-population combinations, the aggregate of pairs of 
fiducial limits r/>pa and r will, in 100(1 — a) percent of the combinations, in- 
clude between them the true value of the range of the population. Further- 
more, whether there is only one rectanplar population for all sample-popula- 
tion combinations or many different rectangular populations, this statement 
remains true, thus showing that the method of fiducial limits for inferring the 
value of the parameter is independent of any a priori distribution of rectangular 
populations in an aggregate of sample-population combinations— -the distribu- 
tion being with respect to values of d, 

Let us look at the matter geometrically. Suppose we are drawing samples 
from a rectangular population with 5 *= 0o . The r for each sample is repre- 
sented by a dot along Or in Figure 1; corresponding to each dot there is confi- 
dence interval cutting across the 7-shaped region MOR. The probability is 
1 — a that a confidence interval computed from a sample from the population 
having range 9o will cut the line 8oK. The cutting of dcK by a confidence 
interval , is equivalent to the statement that flo is included between the corre- 
sponding fiducial limits. 

From a practical statistical point of view what we have said has the following 
meaning; If on each occasion in which a randomly drawn sample of n from 
some rectangular population is considered, one (i) calculates the numbers 
and r, and (ii) asserts that the range in the population producing the sample 
lies between these two computed limits, then in about 100(1 — a) percent of 
the cases assertion (ii) will be correct (theoretically). Thus, in dealing with 
samples of 10 individuals from rectangular populations, one would be correct 
(theoretically) in about 99 percent of the cases by asserting that the population 


range will lie between the sample range and 2.020 



times the sample 


range. More generally, one need not use the same value of n all the way 
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through, provided that for the given a one evaluates according to (3), for 
each n that arises. It will be seen from (3) that as n increases, the value 
of tends to 1 and hence the fiducial limits r/^a and r for any given sample 
tend to the same value, namely the sample range, thus showing that fiducial 
inferences about 6 can be made arbitrarily certain by taking sufficiently large 
samples. 

It is evident that the method of fiducial limits furnishes a satisfactory pro- 
cedure for inferring the value of the population range $ from samples drawn 
from rectangular populations. Let us now go a step further and consider the 
fiducial distribution of d and how it fits into the scene. The cumulative distri- 
bution of tj/ is 

(6) [ti _ _ 1)^] 



.(7) '"■'KOI 

which-^increaaes from 0 to 1 as r increases from 0 to . Geometrically, z «= 
Fiff B) can be represented as a surface defined over the region bounded by lines 
OB and OiS in Figure 1, such that z is aero along 0 and is unity along the line 
OR (r = 9). F{r, 6) is continuous inside the region BOR, and for any given 
value fa 0 of r, F{r, B) decreases from 1 to 0 as 0 increases from ro to ». 
The curves having the equations 
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(where and « are such that ro/0o - and i<'(ro , flj) = a) are the 

curves C and D respectively. C is the cumulative distribution of ranges of 
samples of n from a rectangular population with range . The curve D has 
the mathematical characteristics of a cumulative distribution function cumu- 
lated in the negative direction with respect to its ordinates increase from 

d 

0 to 1 as 6 decreases from » to flo . Thus, if we take — — F(ro , 6) we get a 

da 

function g{0, ru) which has the essential mathematical characteristics of a 
distribution function: it is non-negativCj can be integrated over any interval 
of 6, and has total area under it equal to unity. We have 

(8) gie, n) - nin - 1) 

and it is called the fiditeial diairibution of B for r == ro . It must be firmly 
pointed out that 6 is not a random variable and hence g{6, ro) is not a distribu- 
tion function of a random variable, although it has the mathematical properties 
of such a distribution. Objections have been raised to the use of the term 
fiducial distribution on the grounds that the thing to which it applies is not a 
distribution at all. However, as long as the term is carefully defined there 
should be no ambiguity in using it. From an analytical point of view, the 
problem of obtaining the fiducial distribution of B is only a matter of changing 
variables for since 

(9) , <p{r, B) dr = g{d, r) dB = n{n - 1)(1 # 

and =® rn/yf/t) , we have 

(10) / Bo) dr := / gid, ro) dB^ n(n - 1)(1 - = 1 — a. 

Jro Hk 


We remark again that 

(11) \ g{B^ ro) dB 

is mi to be inteipreted as probability as though B were a random variable. , 
Instead, the meaning is as follows: Let ro be the range in a sample known to 
be from mm rectangular population, and let the value of ro be inserted in 
(11), and let Bi be determined so that the value of the integral is 1 — a. The ' 
two limits for the integral are fiducial limits associated with the sample for the 
confidence coefficient 1 - a, which were discussed earlier. Thus, for each 
sample, we can compute fiducial limits using the fiducial distribution. These 
limits, as we have seen by considering the V' function, fluctuate from sample 
to sample in such a way that the probability is 1 - a that they will include 
between them the true value of the range of, the population under consideration. 

3. Summary of Principles. From the point of view we have taken the 
essential notions involved in the method of fiducial argupaent and fiducial 
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distributions for the case of a continuous variate and one parameter can be 
readily abstracted from the example just discussed. In general, we have the 
following steps: 

(a) A sample is assumed to be randomly drawn from a population with a 
distribution of known functional form/(a;, 5), 6 being a parameter. Let 

j % j ■ • ■ , be the values of x in the sample. 

(b) A function, say ^{xi , > • • , , 5) of the sample x'h and 9 is devised so 

that its sampling distribution G{^) involves 6 and the a:'8 only as they 
enter into The value of 0 in ^ is that for the population from which 
the sample is actually drawn. 

(c) Two numerical values of say and are chosen (ordinarily as close 
together as possible) so that the probability computed from C?(^) is 
1 - a (e.g. 0.95) that ^ will lie between and ^1— more briefly 

< ^ < iAb) = 1 - a. 

(d) The inequality < ^ < \{/„ which contains only one unknown, namely 

is solved for 6 ^ving the equivalent inequality ^< $ < 0 where B and § 
are fidudd limits and are subject to sampling fluctuations. 

(e) The expression ~ I — a is replaced by the equivalent 

expression P(5 <6<fl) = l — a which states that the probability is 
1 — a that a sample will yield values 6 and 6 which will include the true 
value of 6 between them. 


(f) 


The differential element for the fiducial distribution of 0 i,? G{\k) 


ld« 


d9 


(provided is a fimotion of 9 which does not change sign for a pven 
sample of ik's) and is obtained by letting 6 be the variable in G{f) 
keeping the x‘q fixed. : 

To give precisely the conditions under whic'li all of these steps can be per- 
formed is a technical matter which will not be considered here. It is suffi- 
cient to remark that they can be performed in many cases of practical interest. 
Fiducial argument can be carried on using only the first five steps without 
introducing the notion of a fiducial distribution. In connection with step (a) 
it should be particularly noticed that the functional form f{x, 0) of the popu- 
lation under question is assumed to be known and that the sample under 
consideration is “randomly drawn" from the population. Thus, in applying 
the theory to practical problems it is a matter of fundamental importance 
that these two assumptions be valid. In cases where a sufficient amount of 
data exists, it can usually be satisfactorily tested by using the test and other 
devices, whether or not a given functional form for /(a, 9) is a valid assumption. 
In cases where sufficient data do not exist for actually making such a test 
justification for assuming a given function form usually has to be made on the 
basis of theoretical considerations. From a practical point of view the notion 
of randomness is characterized by methods of drawing samples rather thaii 
a posteriori mathematical considerations of the sample after it has been drawn, 
and thus the question of randomly drawng samples depends largely upon the 



278 


S. B, WILKS 


experience and sound judgment of the experimenter. However^ after one or 
more samples have been drawn “at random,” the problem of argmng from 
them about the populations from which they were drawn is largely mathe- 
matical, 


4. Case of large samples, For a population with a distribution of known 
functional form, a fiducial distribution of the parameter clearly depends on the 
size of the sample and the particular estimate used. For example, in large 
samples, we would get a fiduciEil distribution of the mean of a normal popula- 
tion of known variance by using the sample mean which would be different 
from the one obtained using the median of the sample. In order to be able to 
make the inferences about d as accurate as possible, a ^ function should theo- 
retically be used which will produce fiducial limits which are closest together, 
on the average, or perhaps “best” in some other sense, for a given a. The 
fiducial distribution obtainable from such a ^ could then be referred to as the 
“best” fiducial distribution, and theoretically it should be used in preference 
to other possible fiducial distributions if fiducial distributions are to be used 
at all to set fiducial limits. In large samples from a population with a distri- 
bution function /(», 9), it is known [6] that, under rather general conditions, 
fiducial limits which are closest together on the average can be obtained by 
letting 


( 12 ) 







and treating ^ as a normally distributed variate with zero mean and unit 


n 

variance, where iv *= X) log the logarithm of the likelihood of $ for 


the given sample, , aja , • - • , ic* are values of a: in the sample, and JG? denotes 
mathematical expectation. For example, in the case of a binomial population 
where each individual belongs either to class A or class B, we have f{x, 6) = 
ff*(l — where 9 is the probability associated with class A, x will be 0 or 1 
according to whether an in^vidual belongs to B or A. In a sample of n indi- 
viduals, 1/ = m log -f- (n — w) log (1 — ff), where m is the number of individ- 

ualBinctaA. i! andweget * = 

If we should want to find fiducial limits of 6 for a confidence coefficient of .95, 


we would solve (1) the equations 


m — nS 
Vne(l - 6) 


±1.96 for 8, thus getting two 


values of fl, say 9 and 9. We can then say. that 6 and 9 will include the true 
value of 9 between them with a probability of .95 of being correct, in the sense 
that if we applied this rule consistently to samples from binomial populations, 
we would have a procedure that would lead to a correct statement in about 96 
percent of the oases (theoretically). 

To illustrate the difference between the fiducial method and the commonly 
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used method of placing limits on 0 for P = .95, consider an example in 
which m = 150, n = > 400. The usual procedure is to replace 6 by m/n in 

0 dr 1.96 , which yields .311 and .431. The fiducial procedure is 


to solve the equation = ±1,96, for fl, thus obtaining .312 and .455. 

For the case of small samples, the problem of getting “best” fiducial limits be- 
comes more complicated [5]. 

5. Eatensions of Fiducial Argument. It will be observed that it is not 
necessary for to be a function of only one statistic and 0 in order to be able 
to argue fiducially about 6. For example, if a sample of n is drawn from a 
normal population with mean 0, it is well known that if x is the sample mean 
then 


(13) 


_ (5J — 6) V n(n -r 1) 

^ — r " "1^ 

S (X^ - xT 
_ 1 


(which is Fisher’s t function), has the distribution 


41 F(^) ^ 

mn - D) v~ir(n -"T) [1 + l/'V(n - 

n 

Here is a function of two statistics, namely & and (x,- - £)*, and the fiducial 

distribution of 0 for this ^ function is obtained at once by applying rule (/). 

The ideas of fiducial argument may be extended in other directions, but 
these cannot be considered in any detail here. For example may be a func- 
tion of Xi , • • • , Xrt and two or more population parameters, in which case one 
could set up fiducial regions for the several parameters. From a practical 
point of view, the fiducial argument for two or more parameters simultaneously, 
had hardly been touched. Again ^ may be a function of statistics from two 
samples, one observed and the other not yet observed, and not involving popu- 
lation parameters, at all, in which case one can argue fiducially about the 
statistic in question for the unobserved sample 13]. The notion of a fiducial 
distribution has been extended to several parameters taken simultaneously 
{3, 7], but the problem of working out relations between fiducial distributions 
of several parameters and fiducial regions is yet to be investigated. The 
principles may be readily applied in situations in which the x’s involved in ^ 
take on discrete values. In this case the equality signs in the probability ex- 
pressions in steps (o) and (d) would be replaced by greater than or equal signs 
(>). Two excellent examples of the application of principles of fiducial argu- 
ment to the discrete case are furnished: (i) by a paper by Pearson and Clopper 
[8] on fiducial limits of the probability P from samples from a binomial popula- 
tion, and (ii) by a paper by Ricker [9] on fiducial limits of m in the Poisson 
distribution /(x, m) = wV“/x!. 



B.e,fILX8 


REFEMCES 


[1] E.B.f m, ' 'Probable InfeWi tbe Liir of teeseioD, and Statistioil loferetce," 
kr. Meaii MsU itmefiDS, Vol 22 (1927), ;p. 299-212, 



of Stratified Suapliiig and the Method of Fiirpoam Selection,” Eopol SlMtd 
S(ictelf|VolJ|193fiPpJfiH25. 

Is] J JniuH, “Outline of a Theory of Statistical Estimation Based on the ClasmcalTbe- 
vrf of Probability," PMi. IVatt Soy. k. M#, Series A, Vol, 239 (1937), 


17] LE. Shoal, "Fiducial Distribution of Several ParameterswithApplication to a Normal 
System," Free, OenWye Phil See,, vol, 3t (1933), pp. 9H7, 

(8] 0. J, OLom Aun E, S. Pbausou, "The Use of Confidence or Mducial Limits in the 
Case of the Binomial,” fiimajrtib, vol, 29, 1939, pp, 999-913, 

|9| IViLLiAH E, Bioke, "Fiducial Iiimits of tbe Poisson Frequency Distribution,” Jw. 
imim Msfi’eoj Associ'otfott, vol, 32, 1937, pp. 399^98. 


PiniORoii HmvinsM. 



BIOLOGICAL APPLICATIONS OF NORMAL RANGE AND ASSOCIATED 
SIGNIFICANCE TESTS IN IGNORANCE OP ORIGINAL 
DISTRIBUTION FORMS* 

By William R. Thompson 

The word normal has been used in many senses— commonly by statisticians 
to designate a well-known distribution function. Another use familiar to bi- 
ologists, particularly in experimental work and medicine, Is to denote an 
untreated or' control part of a universe, or a part whose members are free from 
specified characteristics such as evidence of past or present disease or malforma- 
tion. Closely related to this last usage are attempts to delimit so-called normal 
ranges of variation for a quantitative attribute of the members of port or all 
of a universe in question. Interpretations are often vague, as when the interval 
between the least and greatest values observed in either a large or a small 
number of instances is taken to estimate a normal range. We shall consider 
the problem of using ranked data for estimating normal ranges as defined in 
the next paragraph. 

If the instances have been drawn at random from a universe (LO of all 
possible observations obtainable in a prescribed manner, and arc enumerated 
in ascending order of magnitude, (itl for i = 1, - * • , n; then it Ls proposed to 
show in the present communication how ranges of the type {xk , in+i_jt) may 
be used to estimate normal ranges, Rf , where the subscript / is the theoretical 
probability that a random value, x, drawn from U will lie within the range R/ , 
g that it wHl lie above, and g that it will lie below (where = 1 - /) . J^irther- 
more, it is proposed to show how these ranges may be used as the basis of 
significance tests where altered conditions appear to lead to abnormal biological 
variation. The form of frequency-distribution of U is supposed unknown, 
and is without effect upon the analysis. Seclion, 1 is a development of the 
theory of range estimation, treated briefly in a previous paper [1] together with 
illustrations of its application. Section 2 deals with significance tests. 

1. The Method of Range Estimation. Let x be a real variate, a random 
value drawn from an infinite universe or population V. Let J{x) be the fre- 
quency function of x in U, supposed unknown; and 1 f{x) dx = L Then 
for any given o and jS, where a < )3, and 

(1) P(a < X < )3) s [ J(x) dx. 


'' * Presented at a meeting of the American Statietical Aagociation, December 28, 1987, 
Atlantic City, N. J, 
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To facilitate development, suppose that in any finite samplbg under considera- 
tion no two values of .v may be exactly the same. Let S « {a;*}, fc = 1, • • • , 
denote a random sample from V,. where the order of enumeration is arbitrary, 
but temporarily taken as a random order (to fix the ideas, consider this the 
order obtained in drawing). Let p* be defined by 

/ Z* 

fix) dx from which dph = /(»*) dxk , 

40 

Then p*, is the probability that a random a: from U shall be less than any number 
Xk . Then obviously if is drawn at random from 17, ph is a random variable 
whose distribution is the unit rectangle; i.e,, P(p' < pk < v") =“ p" - p‘. 
Furthermore, the joint probability that ** will lie in the interval -f dxk 
and that exactly r values in the sample S will be leas than Xk is, to within terms 

of order dpk, “ ^^phiX - PhT'^'^ dpb. 

Then, in repeated sampling as above, for the case where just r of the n random 
values (aji) are I^s than the Jb-th drawn, let P^Av* ^ Ph < p") denote the 
probability that pk lies in the interval (p', p"). Then 

(3) < p") = - - zrl r - (’ ' p'-i'-'iv, 

rl-s! Jpi 

where s « n - 1 - r, and g = 1 — p. Obviously, the expression on the right 
of (3) does not depend on ib if this index is the order of draft or a random index, 
but only upon the condition that exactly r of the n random values from U be 
less than a value % drawn at random from the sample of n values. Accord- 
ii^ly, we obtain the same result if we enumerate the n values in ascending 
order of magnitude. (*< < ai^, if 4 < 7). Then fc =* r 1, in the cases con- 
sidered, and (3) may be written, 

(« p.(p' < p. < p") . 

for 0 g p' g p" ^ 1. Obviously, the result is the same if we deal instead with 
the fc-th value (a:*) of every random sample S drawn. In passing it may be 
noted that for p' « 0 and p" *= p in (4) we have 

(5) Pn(Pfc < p) = Ip{h, n - fc d- 1), ' 

which may be evaluated for fc, n - -f 1 g 50 by means of the Tables of the 
Incompye BetOr-FuncHon [2], 

Of course, ?ft(0 < p* < 1) = 1, and (4) gives p* , the mean value of pk in 
repeated random sampling of n values from U, as 
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Similarly, the variance, of p* is given by 


(7) 


4k * 4(pfc - Pk)*l 


fc(n — + 1) 

(n + l)*«(rt + 2)‘ 


Now suppose that we want to find a range (a, /9) such that, in random drafts 
from Vf the theoretical relative frequency of drawing x less than a is g, and 
the same as that of drawing x greater than |3. (a, |9) may be called a central 
confidence range with a confidence / - 1 -> that x drawn at random, from U 
will lie within the range. For g *= h/{n 4- 1) we may take the range R; — 
(atfc , in-k+i) ; and likewise with g ~ 5% we may estimate, or approximate 
by interpolation where 20fc > n + 1 > 20(A) ~ 1), a range R/ for normal bio- 
logical variation of a specified character, and this may be called briefly the 
estimated 90% central normal range. 


Of course the probability of drawing a: < a is j f{x) dx, and that of drawing 
X > p is J f(x) dx; and these probabilities are unknown, as the frequency 


function f(x) is unknown; but with a - and j3 = aJn-s+i the theoretical 
relative frequency in each case is k/(n + 1) regardless of the universe. 

It has been shown [1] also that if the sample S were drawn at random from 
a finite ordered population of aggregate number iV> denoted by Utr , and Ifpk 
is the number of values in Uir that are less than the h-ih member of the given 
random, sample in ascending order of magnitude; then, for S a sample of n 
values as before, the mean value of pk in repeated sampling is 


* _ Hn-k + D L l\(. _ n\ 

(n+l)»-(n + 2) V WV n )' 

An example is furnished by an analysis of data reported by Wadsworth and 
Hyman [3] in.a study of influences of antigenic treatment of horses upon their 
plasma concentration of esterifled cholesterol, free cholesterol, and phospho- 
lipids. As in chart 1 for normal horses, a graph has been constructed for each 
horse studied, uting toe as abscissa and a logarithmic ordinate scale for ob- 
served values of plasma conc^tration of the constituents: 

1. Esterifled Cholesterol, 

2. Free Cholesterol, and 

3. Phospholipids Umes one-te/rdh, 

the respective succe^ive points for each being joined to form three polygon 
curves. As these are in all cases discrete and lie in the order of enumeration 
from top to bottom of the graph, no special label seemed needed; but estimated 
normal ranges for the central 90% of variation have been indicated in each 
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case by two horizontal lines between brackets at the right, numbered to corre- 
spond "with the enumeration above. The ranges are based on observations on 
62 plasma samples, each from a different presumably normal horse. The normal 
horses in the ^art show about the same individual variations; but, of course, 
the ranges are not to be interpreted to indicate normal variation for an indi- 
vidual animal. . 

Chart 2 presents in like manner the data obtained for horses under immuniza- 
tion against tetanus and the streptococcus, The tetanus immunization treat- 


QAYS . DAYS DAYS 



NORMAL HORSES 

Chabt 1 . On eaoh ^aph for a given normal horse, the number of which appears below, 
the curves in desoenmng order respectively represent (1) esterified cholesterol, (2) free 
cholesterol, and (3) one-tenih phospholipid concentration in plasma (in mg. per 100 cc.). 
Corresponding 90-per-'cent normal range estimates are indicated. 

nient appears to produce marked and sustained depression in all three curves 
of at least five of the six animals observed. 

That this is statistically significant seems obvious. A single observation 
below the 90% normal range should be expected once in twenty random trials 
if normal causes of variation may be assumed unaffected by the treatment in 
question. The expectation of obtaining 5 or more such values in six independent 
trials is obviously much less, and may be accurately estimated by means of rela- 
tions developed in the following section. 
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. 2. SignMcauce Tests, Now consider as in section 1 another sample S' of n' 
values; [a:*' } , lb' = 1, . . . , ?i' (where Xi < x'j if i < j), drawn at random from an 
infinite universe U' as was 5 from U ; but where V and U are not necessarily 

MONTHS MONTHS 


0 6 10 IS 20 0 5 to IS 20 



TETANUS IMMUNIZATION NO IMMUNIZATION 


Chart 2. On each graph for horses reoeiving the indicated antigenic treabment and one 
untreated horse, the curves in descending order respectively represent (I) esterified cho- 
lesterol, (2) free cholesterol, and (8) one-tenth phospholipid concentration in plasma (in 
mg. per 100 ce.). Corresponding 90-per-ceht normal range estimates are indicated. 

the same universe. In like manner it may be shown that, if a/ is drawn at ran- 
dom from JJ' and denotes P(a;' < Xk>), then 

( 8 ) = 

where g = 1 - p, ii = fc' — 1, w = n' — fc', and 0 g g 0" ^ 1. 

The probabhities in (4) and (8) are independent, obviously, whether U' is the 
same as U or not. Accordingly, these relations make possible an evaluation 
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of ?(pfc < pi-) under the circumstances wliere repeated sampling is applied to 
both the case of S and to that of S'. With this understanding, then 


( 9 ) 


nf ^ I \ (r “h fi “H “h "f" 1)! r 4 j j 

?(?>>< Pc) ri'sFl^i 1 P.-trdf,- -i -dp, 


where, os before, r « fc — 1, s = n - fc, v = fc' ~ 1, w = n' — fc', ^ 1 — p, 
and go « 1 — jJo . 

In a previous paper [4] a ^-function was defined as 

— a;\/5 + «' + l+a\ 

(10) ^(r, s, r’, s') = 1=2^^ ^ 


/r + s + 4* 2\ 

\ y+s+1 ; 


for any four rational integers r, s, /, s' S 0; and it was shown in detail that the 
right member of (9) is equal to '^(r, s, v, w ) ; whence we may write 

(11) P{pk < pk') = ’*'(&• - 1, 71 — ft' — 1, n' — ft'). 

Obviously, if U and U' are the same universe, then p* < ph> if and only if 
Xh < tk> , and then we have 

(12) P{xk < Xk') = '$^(fc — 1, n — ft, ft' ~ 1, n' — h/) 


in repeated random sampling applied to both sample types, S and «9f', respectively 
of n and of n' observations. In the paper just mentioned, and in another [B] 
the i'-f unction was further developed by extension of definition to include 
'J'(r, a, —1, s') = 0, and it was shown that 


(13) '3r(r, 8, r', s') s ^(r, r', s, s') s ^(«', r', s, r) s 1 '®’(s, r, s', r'). 

Further demonstrations [6] included the relation, 



which offers another form for calculation. The identities in (13) are particularly 
useful to facilitate calculation where one of the four arguments is small. A 
system for forming a table has also been developed [4, 6] in an economical form, 
but tabulation has been given only for the arguments not exceeding 5. 

Now, in applying a test based on relation (12) or on that for the complemen- 
tary probability, P(xk> < Xk) which obviously, by (13), equals ^(n - ft, ft - 1, 
n' - ft', ft' - 1), we may wish to exclude from the normal set of observations 
those values obtained from animals later given the treatment in question in the 
statistical significance test. The purpose would be to avoid violation of the 
condition of independent sampling required. In the case of the tetanus antigen 
treatment, we have an experience wherein 5 or more of 6 horses treated 3 neld 
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values for a given plasma constituent less than the third in ascending order of 
magnitude (namely jj) in our independent set of normal values. Here w' = 6 , 
and n = 62 - 6 = 56. In accordance with the hypothesis that the treatment 
in question does not affect normal causes of variation in the plasma constituent 
under investigation we have < xs) is ^^(63, 2, 0 -- k', k' - 1). This is 
approximately 1.891(10) ^forfc' = 5, and 4.565(10)”’ for k' - 6 . Obviously, 
a rule for establishing the value of k to be used in such tests should be fixed in 
advance without prejudice, as in the present case where we have taken 
fc ^ fif(i^ + 1) > fc - 1 for p = 5%. 

In the case of streptococcus immunization treatment, the corresponding test 
would have n = 68 , n' = 4, Ik = 3, and k/ = 4, 3, or 2 ; which would yield ap- 
proximately 2.689(10)“®, 1.031(10)“®, or 1.817(10)“*, respectively for P{xk> < * 3 ). 
Thus it appears that where such values are found (intuitively it would 
appear a fortiori if we compare instead with Xi of the entire normal set of 62 
values), their low magnitude appears to discredit the hypothesis that such dis- 
crepancies are ascribable to mere chance normal variation in the quantitative 
attribute investigated. 

The tests proposed are free from any assumption concerning the form of the 
original distribution f{x). The illustrative material is only a part of that pre- 
sented with similar statistical treatment in the paper of Wadsworth and Hyman 
[ 3 ], which makes it apparent that the tests suggested here may be useful and 
powerful in analysis of biological and other experimental data. From a similar 
point of view, Hotelling and Pabst [ 6 ] developed tests of bi-variate conelation, 
and Milton Friedman has elaborated a multi-variate rank analysis [71, the tests 
being likewise free from any assumption about the form of the original distribu- 
tions. In a previous paper [1] confidence ranges for the median are based 
similarly, employing relation (5) for the special case p = 

Division of Labobatoribs and Rbbbabch 

■ New Yobk State Department of Health 
Albany, N. Y. 


REFERENCES 

[1] W. R. Thompson, Annals of Maihsmaiieal Siatistics, Yol. 7 (1936), p. 122. 

[2] Tables of Ike Incomplete Beta-fvnction, edited by Earl Pearsoa, (Office of Biomeirika, 

University College, London), 1934, p. 494. 

[3] AuGUSTire Wadsworth and L. W. Hyman, Jour. Immunol, Vol. 35 (1938), p. 66. 

[4] W. R. Thompson, Biomeirika, Vol. 26 (1933), p. 2B5. 

[6] W. R. Thompson, Amman Journal of MathemcAios, Vol. 67 (1936), p. 460. 

[6] H, Hotiliing AND M. R. Pabst, inwofa of Mathematicol SiaiUtics, Vol, 7 (1936), p, 29. 

[7] Milton Friedman, Jour. Amer. Slat. Assoc., Vol. 32 (1937), p. 675. 



THE COMPUTATION OP MOMENTS WITH THE USE 
OP CUMUIATIVE TOTALS 

By Paul S. Dwyer 

1. Introduction, Variouss authors have shown how the moments of a fre- 
quency distribution may be computed from cumulated frequencies.^ In order 
to make clear to the reader the type of technique under discussion there is 
presented an illustration which is, essentially, that used by Hardy, [2, p, 69]. 
The value = 729 is the last entry in column 4. 

We use Cl to denote the entry in column 4 which is opposite the smallest 
variate (or class mark if the distribution is grouped). Similarly Cj is the entry 
above C \ , and Cj the entry to the right of Cl , etc. In this notation the diagonal 
entries, the ones underscored in Table I, are Cl , CS , Cj , Cj , CE . 

The moments* about the smallest variate can be expressed in terms of the 
cumulations of Table I in different ways. One method utilized the diagonal 
entries and the differeuca? of zero. Thus 

« 6 

= = 2916; E A - Cl + 2Cl = 12339; 

0 0 

' i;*'/. = Ct + 6CS + 6(ll = S7996; 

0 

£ = d + 14d + 36Cl + 24Ci = 278316, etc. 

0 

A second method utilizes the entries in the next to the last row and the differ- 
ences of zero. Thus 

E4 = C1 = 2916; Ei*/,= -d + 2CS = 12636; 

0 . ,0 

, Eli'/. = d --6(1 + 60: = 57996; 

I 

' fl 

, E Hi'/. « - d + Hd - 36d + 24d = 278316, etc. 

q ■ ■ 

' The reader ia referred to reference [1] , , . (16], at end of paper. 

* It ifl to be noted that we are not talking about momenta per unit freijtueMy. We are 
uaing the term in the aenac uaed for example by Whittaker and Robinson. See [20, p. 18). 
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A third method, which! seems to have escaped previous attention, involves 
columnar entries and multipliers whose determination and properties are a chief 
concern of this paper. Thus 

6 e 

E »/. = cl * 2916; E A = Ca + Cl = 12636; 

0 0 

E a:!f, = Ca + 4 Cj + CU 57996 ; 

0 

s 

E = cl 4- licl -f- lies + cl = 278316, etc. 

0 

It is possible also to obtain formulas when the cumulations are made from the 
smallest variate to the largest variate and, indeed, the whole theory of the 
present paper could be duplicated with such a theory of cumulation. 


TABLE I 

Successive Freguency Cumulations 


(1) 

(2) 

(3) 

(4) 

(6) 

C6) 

(7) 

(8) 

X 

X 

1 

F. 



0 

C< 

C‘ 

0 + 6 

6 

64 

64 

64 

64 

64 

64 

0 + 5 

5 

192 

258 

320 

384 

448 

512 

0 + 4 

4 

240 

496 

816 

1200 

1648 ' 

2160 

0 + 3 

3 

160 

656 

1472 

2672 

4320 

.6480 

0 + 2 

2 

60 

716 

2188 : 

4860 

9180 

15660 

0+1 

1 

12 

728 

2916 

7776 

16956 

32616 

0 

■ 0 

1 

729 

3645 

11421 

28377 

60993 


It is possible to obtain the columnar formulas from the well known diagonal 
formulas. Prom the construction of Table I it is clear that 

( 1 ) c! = c1« + c!-‘ 

so that 

Cl = Cl ; C| + 2C| = Cl + cl ; d + 6C| + 6Cl = C| + 4C| + Cl ; 

Cl + 14C| + 36CI + 24C| - Cl + 11C| + llCl + C| 

Formula (1) can be used similarly in deriving columnar formulas from row 
formulas, diagonal formulas from row formulas, etc. 

The columnar method is here recommended as a useful substitute for the 
usual elementary method of computing moments. The many multiplications 
involved in the usual process are replaced by continued addition. The chief 
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disadvantage of the method is the continual recording, although this obstacle 
is surmounted "with an adding machine equipped with a recording tape. The 
resulting moments are easily cheeked with an adaptation of Charlier’s check, 
as is shown in section 8; and methods are given by which the multipliers are 
easily obtained. The method is also well adapted to the use of Hollerith 
machines, 

The introduction of sucl^ columnar multipliers tends to give a different empha- 
sis to the cumulative totals technique. The use of diagonal entries led logically 
to an emphasis upon factorial moments, while the columnar method tends to 
emphasize the more familiar power moments. The primaiy application here 
indicated is not to elaborate and specialized techniques, but rather to the simple, 
though often tedious, problem of the computation of power moments. 

The aims of this paper are then: 

(1) To show how moments may be computed from the columnar values of the 
successive cumulations, 

(2) To discover the properties of the columnar multipliers, 

(3) To present a general theory for computation of moments using cumulative 
totals. 

2. The Basic Cumulative Theorem. The use of (1) is not satisfactory in 
getting precise formulas for the columnar multipliers so we derive the columnar 
cumulative theory directly from first principles. We first prove 
Theoeem I. Let x le any real number and lei Ux he a read function of x which is 
0 token X < a and when x > a -i- Jc and which is not infinite for x <=> a, a -i- 1, 
a 2, * ■ • , 0 4- fc. Lett, he a real function of x and ti* , called range ti* , a func- 
tion such that lix « V# when x^a, a-fl, and Us = 0 at aU points 

outside the range a to a k. If ^ indicaled by Gut, and Wt — v»_i by V , 

Z 

& - hy V Hz then 

(3} ^ WxCjd ^ • 

a a 0 

The values w* , , Cut , V?), are presented in Table II. 

The theorem is proved by forming 

i^ib 

2 s Uo+ibaa+fc "!''■•+ «B4iao+< + • • ' -f- t/oWa 

a 

o+A 
a , 

Theorem I can also be written as 

* fc 

(4) £ Wa+aVfl-M * £ 

0 O' 



COMPUTATION OP MOMENTS WITH CUMULATIVE TOTALS 


291 


3. The Successive Cumulation Theorem. 

Theorem IL If C\ = C[Cw*l and V = V(Vy*), etc., then 

a+fc a+Js 

iC ^zVx = £ UxVx = £ 

o a a 

This theorem follows readily from. Theorem I. If 

Ux ^ Cux and Vt *= Vw* , 

^ tt+ft a+fc a+ft o+k 

£ UxVx = £ = £ UxVx * £ cUx^Vx = £ 

«• a a a a 


This process can be extended as many times os desired so that 

tt+h 

(5) £ UxVx = £ UxVx = £ 


then 


TABLE II 


yoZucs of X, , and Vy* . 


X 



Ciu 

; V«, 

a + k 


Va+Jb 


l^a+k "■ •>*+*-! 

ft + fc — 1 


Ka^-fc-t 

■Ufl+t + Uo+fc-1 

Wo.).V-l “■ Va4-k«S 


mSm 





HH 




ft d* i 

Wo+j 

Va+i 

W«+* + • " + 

®d+< ■“ t>a+{-l 


■■lllllll 

■■III 




HB 




ft + 1 

Wo+l 

i 

«(!+* + • • ■ + ««+( + • ■ * Ma+1 

ffo+l “ da 

ft 

«o 


1io+lt + • • • + M«+i + • ‘ + W«+l + Ua 

' Va 


This can also be written as 

k k k 

(6) ^ j Ua^.41 tig,].! “ Wo4-i1^a4'® ~ ^ So+a* 

0.0 0 

In order to determine the values V*’'’*t!a+» , 0 < a; < fc, we note that 

(7) V+'!>.h. = E 
SO that 

(8) = E (-«' (® ■J' 
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We also know that, x<h 

= Ha+i-i when i < x 

(9) 

lla+z-t == 0 when t > x_ 

so that 

(10) v’''‘a,+, = E(-l)'^'[’^^tk+^(, 0S®S« 

(11) V-^’l!.„ = i (-1)‘(' I = V+‘».+., a<xik.' 

The formula (6) can then be written 

a+k k » A 

(12) L = £ «.«».+, = £ + £ c"^‘u.«v^‘».+.. 

4 0 C «+l 

4. Moments from the Cumulated frequencies. If Ua+x « fa+x and 
“ (fl + then (6) gives 

(13) £ (a + xr/». - 1 0‘*%.r*'ia+j)\ 

0 0 

A more useful formula, obtained from (12), is 

(14) £ (o + xru = £,c^‘/.+.v+‘(i±^*, , 

0 0 

since (o + »)* «= 0. We have then 
Theorbac III. The values of the s-th moments can he obtairied from the last 
8 + 1 eniries of the (s + l)e« cumvMion of thefreqmndes. The muUipliers are 
the values 

(15) + a?) * « 2 (-1)' "I (o + a: - t)\ 

Cor. 1. When o =* 0, i,e. , when the moments are measured about the smallest 
variate, the multipliers are 

(16) £(-!)'('’+')(*- O'. 

Qot. 2, When o = 1, the multipliers are 

(17) v‘«(i+£)' - £ (-1)' (* + ^) (1 + * _ ly. 

Cor. 3. If the moments are measured about a fixed value, p, then the new 
smallest variate is o - p *= o' and the multipliers are (a' + x)*. 
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Cor. 4, If p is the mean, m, then a' = a — m. If in addition o = 0, then 
o' = — m and the multipliers giving moments about the mean are {x — m)'. 
Now 


m 



C^v'O + Cjv’*! Cl 
Ci " ^ CY 


It follows that the multipliers giving the moments about the mean are 

0.,^ '"(•-i)' 


It is to be noted that the moments about different points are obtained by 
applying different multipliers to the same cumulated frequencies. 


5. Values of the multipliers. The values of the multipliers may be computed 
from (15). Thus V^( a + 1) ^ = (o + 1)* — 3a® = -2a® -f 2a + 1. This be- 
comes 2ab -h 1 when 1 -- a is set equal to b. Values of the multipliers for the 
most common values of s and x are presented in Table III. 


TABLE III 
Vahies of (a -f a;) * 


!C 

0 

1 

1 

2 

3 

4 


■ 

■ 



b* 

3 

■ 




4b»fl 4 - 6b» 4- 4b -h 1 

2 

B 

H 

b* 

3b*o 4- 3b + 1 

6a*b* 4- 12ab 4- 11 

1 


b 

2ab -f- 1 

3a®b 4- 30-1-1 

4a®b 4" 6o* 4- 4o 4" 1 

0 

1 

a 

a* 

a® 

a^ 


Wheno = 0,b = land the multipliers are 1;,0, 1, 1; 0, 1, 4, Ij 0, 1, U, 11, 1; 
etc. as indicated in section 1. When a = 1, b = 0 and the multipliers axe 1; 
1, 0; 1, 4, Ij 0; 1, 11, 11, 1, Oj etc. When the moments are measured about a 
fixed point, p, it is only necessary to compute o' = a — p and to use a' for a 
and b' = 1 - o' for b in Table III. 

We illustrate the use of the multipliers by application to the problem of 
Table I. The moments about the smallest variate are computed in section 1. 

* A 

The moments, when o = 1 are 2^ (« -f- 1)/* - C® = 3664; S (aj + 1)% = 

* A A . • 
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Cl +• Cl = 19197; L (a + 1)V, = Cj -}- iCl + Cj = 105381; i) (a + l)V, = 

0 0 

cl + licl + licl + cl = 598509. 

C* 2916 

The moments about the mean are found by forming ~ = 4. Then a 

»= -4 and the multipta are 1; -4, 5; 16, -39, 25; -64, 229, -284, 126; 

SB 6 

256, - 1199, 2171, - 1829, 625; etc. ao that E == 0; E * 972 ; E ^ 

0 0 0 

-324; E = 3664. „ 

0 

Since the values of - Cl/Cl)* are expressible in terms of Cl and Cj, it 

follows that the values of E expressible in terms of cumulations. For 
0 

example a formula for the second moment about the mean, which is essentially 
one given by Whittaker and Robinson [7, p. 193] is 

a+k {ni\i 

(19) = + 

* 

However the general method described above, supplemented with the tech- 
niques of succeeding sections, is preferred to the development and use of such 
formulas, 

6. Recursion Property of the Multipliers. It is not readily apparent from 
Table III how the multipliers of the (« + l)-th oumulations can be obtained 
from the multipliers of the e-th oumulations. It is possible to establish a re- 
cursion formula which is useful for this purpose. Now, a < m < s, 

v^*(a+»)' = («+*)■+!: (-1)' I ^) (« + * - «)■ 

(» + »)?*(»+»)*-* •= (® + a)' + 1 (-1)' (;)&»+*- ()■'■(« + *) 

(s + 1 - a - g)V* (o -I- g - 

= ^ 1)‘ ^ ^ + 1 — a — aj) 

and since 

(a + ^ (s -b 1 - a - ic) = "J" (fl -f- - 0 

it follows that 

(20) A’+\o4^)' « (o + + (fi + 1 - a - a?)7»( a -]- a; - 1 )*~\ 
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When a = 0 we have 

(21) v"^V ^ + (s + 1 - x)v\ x -- iy ~\ 

Formulas (20) and (21), though somewhat formidable in appearance, are easy 
to apply. Thus V^( o + 2) ^ =» (a + 2)V^( a + 2) -f (I - a)V^ (o + !) ■ The 
recursion formula is especially useful in building up tables of multipliers. The 
following form is recommended: 

As successive columnar headings use the values a, a + 1, a + 2, etc. and as 
successive row headings use 1 - a, 2 •- o, 3 - a, etc. Then » 1 is placed 
in the upper left cell, V*a directly below V®a + 1 to the right of vV, etc. 
The values of V^( a + are placed in the next diagonal, etc. If this process is 
continued the entry V*^^ (a + a?) * will have the entry V*( a + directly above 
it and the entry V*( a + a; — 1) *"^ on its left. Also the columnar heading is 
a + * and the row heading s + l-' 0 -"»so that any entry is obtained by 
adding the product of the entry above it and the columnar heading to the 
product of the entry to the left and the row heading. The values of V*’*'^®* 
axe obtained by placing a = 0. They are presented, in Table IV, through 8=8, 


TABLE IV 
Values of v*+V 


\ 

\ ® 

8 +1 — ®\ 

0 

1 

2 

3 

4 

5 

■ 

■ 

3 

1 

1 

1 

1 

1 

1 

1 

1 

1 

1 

2 

0 

1 

4 

11 


57 

120 

247 

i 


3 

D 

n 

11 

66 ' 

302 

1191 

4293 



4 

0 

1 

26 

302 i 


15619 


■ 


5 

0 

1 

67 

1191 

15619 





6 

0 

1 

120 

4293 






7 

0 

1 

247 







8 

0 

1 









The table is easily extended to higher values of s. If a table of values of 
(x -1- 1)* is constructed, it will be found to be like Table IV with columns and 
rows interchanged. Hence the values of 4- 1)* are obtained from Table 
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IV by reading the multipliers dow the diagonal. Thus the values V*(x + l)* 
are 1, 4, 1, 0, etc. 

The ease with which the multipliers may be computed is illustrated with 
tt ~ — 4. In this case we have 


TABLE V 

YduM of ( a; -f q) * wih a = — 4 


\ 

\ o+a; 
\ 

s 4 1*" \ 


-3 

-2 

-1 

0 

5 

< 1 

1 _ ... 

5 

25 

125 

1 625 

6 

-4 

-39 

-284 

-1829 


7 

16 

229 

2171 



8 

-64 

-1199 




9 

256 






These values agree with those computed more laboriously in section B. 

It 

7. Value of 4- a)'. It is to be noted m Tables III, IV, V that the 

0 

sum of the entries in the diagonal having 5 4- 1 terms is a I This is generally 
true and resulte from the fact that 

k 9 

(22) Z V‘+‘(ir 4- a)‘ *= £ 4- a)* = s! 

Q 0 

> i 

In obtainii^ the values of £ 4- from the value of £jv*‘^Va 4- »)* 

0 0 — — — 

it is noted that 4- o) * is used but twice. Once it is multiplied by o 4' « 
and once bys4'l - a- irso that the net result is a multiplication by « 4- 1. 

k 4 4 

It follovra that £ 4" (s 4- 1) £ V*'*'^(x -f a)* and since £ V*(x 4* 1) 

0 0 0 — ■ — 

.4 ' ' .4 I 

“ 1) £ 7^ (x + 0 ) ^ = 21 BO that in general £ 7*~*’‘ (x 4- tt) * « si 
This property is useful in checking the values of the computed multipliers. 

8. The adaptation of .the Charlier check. An adaptation of the Oharlier 
check serves as an excellent check for the computed moments. It is recalled 
that the Charlier check gives 

a+fc » / \ 

5:(j+i)v.=i;(ni: 

a t»0 \l'/ ^"0 


(23) 
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The components of the right hand member are computed by cumulative totals 
as indicated above. The left hand member is obtained by applying different 

o+A k 

multipliers to the same cumulated frequencies. Thus £ (« + 1)?» = S « 

0 0 

4- lYft+a and the multipliers of the cumulated frequencies are 

where o' = tt+l. Ifa — 0 the Charlier check multipliers are the values 

t 

4 1)* which can be read from Table IV. For example £ (a: 4- 1)*/* — 

s ** 

Cl + llCa 4 11<?3 + CS “ 598609 and this checks with £ x% -f 4 £ 4^ 

0 6* 00 

6Ex'/. + 4Ejjf.+ E/.. 

0 0 0 

9. Application to factorial moments. When u* =/»,»» = = 2 {a! — 1) 

{» - 2) . . . - fi 4- 1) 

0 0 

and since is 0 when « < x < fc, is s! when s = x, is 0 when 0 < x < s, 

(24) E*'*’/.-Ex'"/.-s!C!li. 

0 ( 

It follows that the underscored terms of Table I, when multiplied by si, give 
the factorial moments. Factorial moments, first used by Sheppard [4], have 
since come into prominence largely because of this ease of computation. 

sc(x 

The coefficients of (a 6)* are 1, x, ^ j ■ • • > » * • • • define 

k U) ' 1 A , 

the binomial moment by B. = £ — r [6, p. 278] then B, = -j £ = Cl+i . 

0 81 8l 0 

it is also possible to show that the entries under the main diagonal are bi- 
nomial moments. In Table I, for example, we let o = 1 and add the additional 
row a ~ 0 with 0 frequency. Then Cl « 729, Cl = 729, Cl *= 729 4- 3646 = 
4374, etc. The new ffiagonal terms are directly under the old diagonal terms and 

7 6 

give B .,1 = £ x^'V* = £ (x + . In general the terms B,,j are given I 

10 

Tows below the terms B, and the factorial moments are s I B.j . Then 
(26) ?.,i = slCSi-,. 

For example in the problem of Table 1. F*.i * E x**/. “ 4!Gi = 782,784. The 

method is especially adapted to the use of Hollerith machines, for positive 
integral values of I, since it is only necessary to have the machine continue its 
cumulation. 
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10. The cumulations of a:/* . It is possible to use the cumulations of a/* in 
securing the values of the momenta. Now 

c+k k k 

E = E (» + = E (a? + + a)* 

. V « 0 “ 

(26) 

0 

When a = 0, (26) becomes 

(27) E*'+V. = £c^V.7^'*'- 

0 a 

We compute the cumulations of zf for the problem of Table L These are given 
in Table VI. 


TABLE VI 


Cumulations of s(f„ 


X 

u 


Cl 

1 

0* 

C» 

C* 

6 

34 

384 

384 

384 

384 

384 

6 

192 

960 

1344 

1728 

2112 

2496 

4 

240 

960 

. 2304 

4032 1 

6144 

8640 

3 

160 

480 

2784 

6816 

12960 

21600 

2 

60 

120 

2904 

9720 ' 

22680 

44280 

1 

12 

12 

2916 

12686 

36316 

79596 

0 

1 

1 I 

2916 

16653 

50868 

130464 


so that 

6 B A 

E »/* « 2916; £ kV* = 12636; £ « 35316 + 22680 « 57996; 

0 0 .0 

« 

£ s% = 79696 + 4(44280) + 21600 s= 278316. 

0 

In getting moments about the mean from the cumulations of zfx , the follow- 
ing method is recommended. 

(28) £ a5*'''V, = £ - m)ft « £ - wi £ 2*/#. 

0 A 0 0 

and 

(29) -!»)■• 

0 0 

k k k 

When s = 1, (28) gives £ sV» = £ :f m £ $f^ and 

0 0 0 
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(30) 2] ^ 

0 0 

In the illustrative problem a == - 4 so that 

t 

E W* = -4(15662) + 6(12636) = 972 
0 

e 

E **x/. = 16(50868) - 39(35316) + 25(22680) = 3664 

s 

E «Vx = 2268 
0 

and 

« 

E = 972; E = 3564 - 4(972) = -324; E = 3564. 

k 

Formula (30) is of note since it permits the determination of E directly from 

0 

the cumulations of x/, . 

The factorial moments are also related to the cumulations of x/* . Thus 

(31) ti “ S (* - i)'-V. = 2 c'(^r.)r(* - 1)'-" 

0 0 0 

h 

which results in E * (s — 1) !C'!(x/»). 

0 

It follows that 

c;(a/,) = ac:x\{f,y 

For example, the underscored terms of Table YI are respectively 1, 2, 3, 4 times 
underscored terms of Table L 

In general the cumulations of x/« , rather than of U , are recommended since 
C{3^s) can be computed and recorded almost as quickly as C(Jz), since one less 
cumulation is needed to obtain a specihc moment, and since the multipliers 
needed to get a specific moment are smaller. A technique based on the cumu- 
lations of x/a is especially adapted to the use of Hollerith machines. Let us take 
Xi to represent the sum of the x’s for all items in the distrib^ution having the 
same value of x. Then x/* = x, and we have 

a+Jk a+fc a4-A 

(32) E a;*/. * E = E C'*(xr)v*(x*"'). 


If the cards are sorted for x and the tabulator is wired to print cumulative totals 
each time x changes, the recording tape gives the successive values of C(x*). 
(Care must be taken that there are no blank values of x.) 

If a summary punch is available, these cumulations are punched on cards as 
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they are cumulated and these summary cards are used in getting higher cumu- 
lationfi. 

If no summary punch is available, it is possible to obtain 2 by the applica- 

tion of Theorem 1. Thus 


B+fc n+i B+fc 

S a:*/* = S ajaJi = £ C(a;*)V(a:), 


a-t-fc 

and since V( 5 c) = a when a; =* a and V(¥) ~ 1 when a; > a, it follows that £ 

' ■ ® . 
can be obtained by adding the entries above the last and then adding the last 
entry multiplied by a. This is essentially the Mendenhall-Worren-Holleiith 
method of getting £ x% [9, p. 27]. 

In case a = 0 the technique amounts simply to adding all the entries above 
the bottom one. 

The value £ x% can be obtained similarly from the first order cumulations. 
Thus 

o+Jb a-hk o+i 

(33) E a;'/. = E = S C(ii)v(i‘) 

fl fl 0 

and tince V(a:®) = a when x ^ a, V(^ = 2a: — 1 when x > a, it follows that 



£ x% = a*C?i(3;*) + £ C{xs){2x - 1). 

B B+l 


When a = 0, (34) becomes 

(3B) ' E*'/. = Ec?(®.)C2*-1) 

0 1 


BO that the multipliers are the successive odd integers. Thus from the first 
order cumulations of Table VI we have 

6 ' 6 6 

£ xf, = 2916; £ x% = 12636; £ = 57996. 

0 O’ O’ 

The cumulative method can also be applied to the method of digiting [17, 
p.425]. , 

It is also possible to obtain the moments from the cumulations of x% , x % , 
etc., since 

B+fc n+fc o+fc 

. 'E = E = Ec'+V/JV+V) . 

o fl C 

fl+fc ii+fc o+A 

E T'*'}. = E = S c'V/.)v+'(**). 

.ft 0 fl 

but the cumulations of »/* are preferable for most purposes. The Charlier check 
works in all cases. It should be noted that the indicated Hollerith technique 
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dBinSiiids only the custoniEry tubulstor Siud not the expensive, time consuming, 
card punching, multiplier, [16], 

11. ^ Product Moments,' Correlation. It is possible to apply the cumulative 
technique in getting product moments involving two variables. If we let j/* 
be the sum of all the values of y having the same value of x, then 

a+A o+a 

(36) E = E = E 

c a 

so that the multipliers are the same as those previously used. When Hol- 
lerith maohineB are used, it is only necessary to sort the cards for x and to wire 
the machine to give cumulations on variables x, y, s, etc. If the machine is 
. adjusted to take totals with each change in x, the tape records simultaneously 
the values of C(x^), C(yg), G(gs), etc.. With a summary punch it is possible to 
form successive cumulations easily. The values Sx*y, Sx'z, etc. are then 
obtained by applying the multipliers. When s = 1, (36) becomes 

fl+j 

(37) E xyfsv = E 0%)7‘(x) 

a 

so that the multipliers are o, 1 — a, 0, 0, etc. When o = 0, the multipliers are 
0, 1, 0, 0, etc. and when a s= 1, they are 1, 0, 0, etc. 

When no summary punch is available, it is necessary to obtain the vailues of 
the moments from the first order cumulations. Using Theorem I 

o+* a+i 

(38) E xyfxv = E C(yJV(z) = aCKyJ + E U(y,). 

This formula serves as the basis of the Mendenhall-W arren-Hollerlth Correlation 
Method, [9, p, 27]. 

It can be shown in similar fashion that 

(39) !:*■!(/■„ = a=c! + £c(».)(ife-l) 

a+1 

and when a = 0 

(40) E =“ E C(yT)(2x - 1). , 

The method is also adapted to the common problem of finding correlation 
coefficients from grouped data when Hollerith machines are not available and 
this method is recommended for the determination of these coefficients. 

An illustration is presented in Table VH' which shows the correlation existing 
between college first semester average, X, and preparatory school average, Y, for 
1126 students entering the College of Literature, Science and the Arts of the 
University of Michigan in 1928. The coded values of Z and Y are indicated by 
X and y and are positive integers beginning with 0. The coded values are given 
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itt descending order beginning with the upper left hand corner of the chart. 
The values of the cumulations are placed at the right hand side and at the bot- 
tom of the chart. 


TABLE VII 

Correlation toilh cimvlalive Molt 


(1) 

(2) 1 

(3) 

(4) 1 (6) 1 

(6) 1 (7) 1 (8) 1 (9) 

(10) 

(11)|(12) 

(13) 

(14) 


■ 

■ 

■ 

ittl 

B 

B 

m 


1R1 

m 

m 

B 





X 

B 

8 

. 7 

6 

5 

4 

3 

2 

1 

0 



■ 

■ 

B 

13 

i 

107 

220 

341 

179 

121 

60 

1 



4.00 

6 

IS 

S 

2 

5 

S 

■ 

■ 

■ 

B 

B 

113 

■ 

3.99 

3.60- 

6 

106 

2 

19 

29 

27 

■ 

7 

1 

1 

1 

673 

IQ 

5 

4 

178 

3 

12 



44 

18 

1 

6 

2 

1608 

1350 

2.99 

2.60- 

8 

270 

3 


20 

66 

108 

33 

27 

11 

8 

2568 

2160 

2.40 

2.00- 

2 

330 

■ 

■ 

11 

64 

1 

07 

46 

19 

13 




X 

173 

1 

1 

5 

19 

46 

IB 

Bh 


18 

1 

4244 

2993 


0 

51 

1 

■ 

2 

7 

14 

10 

6 

6 

■ 


2993 



Cy, 

61 

269 

661 

|H 

2194 

2678 

2809 

2923 

2993 

12815 

■ 



Csx 




■ 

1 


li 

liii 

■ 


EB 



The lower right hand comer has the entries 


I* 

Lv 

2* 2v 


Zy ’ 
ly’ ' 


where 2 2 luid obtained by adding 

the cumulations in the columns or rows involved. 


The values are easily computed from columns (2) and (3). The values 
of (?(av) are computed by forming the cumulated product of the row frequency 
and X. The values are recorded when the products contributed by a given row 
have been computed. The values C(i/„) and C{Xx) are obtained similarly. 

The value of r k easily obtained from the lower right hand entries . The value 
Ag,y = Nlxy - (Sa;)(2y) is obtained from diagonal entries, A*,* »= — (Sa;)* 
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is obtained from entries in the last row, - (2y)* ia obtained from 

the last column, and r = *' is easily computed. In the above problem 

r = .441. 


The values iW* , Jlfy , (t* , <r„ are also easily obtamed from the lower right hand 
entries. The successive steps are indicated by the form 



2x 

sy 



Uy 

sy 

Sxy 





2x 

Sx* 

m 

AjC,x 





Ay.v 

Ax,v 

>/ Ay ^ 

ffy 



... 

VAt,z 

y/ Az,9Ay,y 





V* 


r 


Recent methods of applying cumulative totals theory to correlation are found in 
references [91, [14], [17], [18], [19]. 

The third order moments are obtained by multiplying the entries of C{xy), 
CiVv)} ('iVt) by 1, 3, 5, etc. as indicated by (40). Thus 2a;% = 4399 + 3 
(4339)-!- etc. * 102, 103; Sa;V*v = 63121; ^ 46047; = 38,633. 

It is hence possible to compute the skewness of each marginal distribution from 
Table VII. See also [18, p. 657). 

12. Conclusion. This paper presents an outline of the computation of 
moments with the use of cumulative totals and columnar multipliers. Basic 
general theorems are derived and applications are made to one variable and two 
variable distributions both with and without punched equipment. The 
formulas assume that the distance between successive variates (or class marks) 
is unity, but the reader should have no trouble in adapting the formulas to more 
general problems. 

In the interest of brevity the development is limited to the descending cumu- 
lations, It is possible to parallel the development here by deriving formulas in 
terms of ascending cumulations. It is also, possible to work out formulas show- 
ing relations between columnar, row, and diagonal multipliers. There are 

other applications such as to the evaluation of £ x*, which are of interest. It is 

possible also that applications may be found for the general theory of sections 
2 and 3 which do not demand that v» be a power function. 


THB UmVBRSITT OF MlOHIQAN. 
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A NOTE ON THE DERIVATION OF FORMBXAE FOR MULTIPLE 
AND PARTIAL CORRELATION* 

By Louis Guttman 

1. Multiple Correlation. Lot the measm-ements of N individuals on each 
of llie 11 vaviablos * 1 , ;V8 , • • • , Xi , • . . , , be expressed as relative deviates; 

that is, such that 

2*4 = 0, (; = 1,2,3, 

wliere the .summations extend over the N individuals, 

If values of h a-w* dotei'inined so that 

21(xi - XjXa “ XaXj - . . ■ ~ \^Xnf is a minimum, 

and if we let 

(1) iVt = XjXj + XjXj -f • ‘ + X«a5n , 

then the multiple eorrelatioii coefficient, obtained from the regression of xi on 
the remaining n — 1 variables, is defined as 

ri.S34**.n ~ ^'siATi • 

The square of the stundard error of estimate of Xi on the remaining « - 1 vari- 
ables lA defined a.s 

Vl.234.--» = ^S(x.i - Xj)". 

The miiihuiriing values fur h are obtained from the normal equations 

(2) 2;(i5i - XOaii - 0, fc«2,3,...,n. 

which may be written in expanded notation as, 

X'j -\r J’jaXa + Tu\i -f* • • ' “h ria 

TsiXa -j- Xa + J’siXii -{-••• + J’SnXn ~ Tn 

TtiaXs “1- 7'«3 Xs 4* *)-••'+ X,, « rjij 

1 

where ^ Sa:^a?A « r*./, r,-/ = 1. 

• The notions involvod in this demonstration are certainly well-known. However, 
the directness and simplicity of the derivations may lend some mfint to their exhibition. 
The writer is indebted to Professor Dunham Jackson for useful advice. 
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From Cramer’s rule it is seen that 


' Xa “ ^ k 7^ If J2u 0, 

XVll 

•where Byt is the cofactor of tja (or of taj) iu the symmetric determinant 


rii 

Ta 

r„ ... 

Tin 

Til 

r« 

fa 


... 

.... 

- 

i • • 

Tni 

Tni 

Tni • ’ * 

"^nn 


Sumrmng both sides of (1) over the N individuals shows that SJfi = 0, so 
that the variance of Xi is 

* _ 1 ■gv* 


From (2), the residual (a:i — Xi) is orthogonal to each of the Xk except xi ; 
therefore the residual is orthogonal to any linear combination of these Xk and 
in particular to Xi ; that is, 


( 3 ) 

or 


and therefore 


2(®, - Xi)Xi = 0, 


— ffjri 


( 4 ) 


rsijfi ~ • 


Multiplying both sides of (1) by and summing over the individuals, we get; 


ffiiTztXt - J’uXj -h ^'jjXa + ' ‘ • + rinXM 


d" ruBia risBin) 


From (4) then, 




1 


Rn 




1 - 


Rkk 


It is clear that in general 
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To find the standard error of estimate, expand 

— XiY = 1 - 2crx^rgjXi + O’*! 

= 1 rSjTi 

- s. 

flu' 

In general, when tr* = 1 , 

^kk 

2 . Partial Coirelation. If values of /x« and vt are determined so that 
S(a:i — n^% — pL^i — ... — is a minimum 
and S(»i — j'jx* — viXt — ... — is a minimuin, 

and if we let 

, ^ — ^3*8 + + * * ■ + M"®" 

( 6 ) 

Fa = VtXt + J'4»4 + ■ • • + t'nXn , 

then the partial correlation coefficient between Xi and Xi , holding the remainii^ 
n — 2 variables constant, is defined as 

and since I{xk — Yk) = 0 , 

ri3.a4...n = . 

<^1.8<...n®’2.84.*.ii 

Each fik is the negative of the ratio of the cofactor of to the cofactor of ru 
in the determinant obtained by striking out the second row and the second 
column from J2. We shall use the notation Rhi-ft algebraic com- 

plement of the second order minor in B, whose complement is obtained by 
striking out row h and column i and then row j and column k. Then 

p > 

JKat-n 

By argument similar to that used in (3), 

Z(a:i - Fi)F* » 0, 
or 

XXiYa »= SF 1 F 3 . 
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Then the numerator of the right member of (7) beciomps, after expanding and 
collecting terms, 


( 8 ) 




Xi > 

Multiplying both sides of (6) by and summing over the H individualK, we have, 


(TYjtiYi “ + hiin + ' • ' + r2riM» 

1 


( 9 ) 


ife'ii 

ss ri2 + 


(%f222.13 + r2lft2.l4 + ‘ f TiAAn) 


fil2 


Analogous to (5), we have, 
(10). 


2 ^^22 2 Rl[ 

' ii22-ii mm 


From (g), (9), and (10) the right member of (7) becomes 

VRAi 

It is seen that in general 
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NOTE ON REGRESSION FUNCTIONS IN THE CASE OP THREE 
SECOND ORDER RANDOM VARIABLES 

By Clyde A. Beidgee 

The study of the correlation of two second-order random variables has re- 
ceived the attention of several authors, among them Yule [1], Charlier [2], 
Wicksell [3, 4], and Tschuprow [5]. Yule writes of them under the guise of 
“attributes." The study of three or more second order random variables has 
lagged behind. In this note we shall examine the regression function of one 
second order random variable on two others by considering the problem from 
the point of view of Tschuprow’s [6] paper on the correlation of thee random 
variables. 

A variable X that takes on m values iCi , • ? • , Xm with corresponding prob- 
abilities Vif • • • subject to the condition £ = 1 is defined as a random 

i 

variable of order m, (In particular, if X takes on only two valu^, z and 
with probabilities p and q, where p + g = l,Xisa random variable of second 
order.) The system of values z and probabilities p constitute the law of distri- 
bution of X. In the case of two random variables, X and 7, there exists a 
joint distribution law, covering all possible combinations of X and 7, together 
with their associated probabilities Pu i • • ■ i Pmn the joint distribution law con- 
tains all of the information regarding the stochastical dependence of X and 7. 

The extension' to more than two variables is immediate. Let represent 
the probability of the simultaneous occurrence of the set of values Zi , yj , Zh 
of three random variables X, 7, and Z; pi/ , that of the simultaneous occurrence 
oixi^yj together without reference to 7; p( , that of the occurrence of without 
reference to 7 or Z ;,etc. Then, we have relationships of the types 22 2 Pm 

i i It 

= 2 2 Pi/ “ 2 Pi = 1; 2 Pi/fc - p/fc) E Epi/* = E Vik- E put = Vk- 

i i i i if i i 

Similarly, let pj* be the probability of the simultaneous occurrence of y,- and 
ik on the condition that X takes on the value Xi ; pS'^ that of the occurrence of 
l/y without reference to Z, on the same condition; etc. Then 

Z P?’ = Z pr = Z Z pS’ = 1; Z p}f = pS"; - k 

h k . i b ■ i 

PijVk^^ - PiPik - PiPf^Pk^ -Vifk] , E PiPi^^ = Pit ei-c. ' 

i 

Denoting by Eiz) or simply the expression “the mean value or mathe- 
matical expectation of x," we have wm EX^Y^Z^ = E E ^ ■. 

In particular, the mean values of the distributions are given by Wx = EX 
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“ ]C Pi*<» wjr = EY ’=* ]C PiP/j ftiz ^ EZ — ^ pjrPfc. Then we may write 

" ®(^ “ »»x)^(T — my)'(2? - = JSu'y'to* = 2 2 £ pi'/*(JCi ~ Wx/ 

i i k 

(l/j - mr)*(«h - Wz)*- The quantities /t may be identified as terms in the 
expression for the moments for the sum of ‘three variables as follows; E{u + ti 
-b w)" * JSitt” + nEu'^'h ^ . . . .f fcjBt/tf V JBto", where f + g k 

» n. If n « 2, we have the variance of the sum of three variables given by 
M».. -b + M.a. + 2 m.ii + 2 mi.i + M-a i where the dots in the subscripts indi- 
cate variables not considered, Thus w- refers to the second moment of the 
distribution of the variable X about its mean, mx , without consideration of the 
distributions of Y or Z, If every term of the expansion of the n-th moment of 
the sum of three variables is divided by the quantity the expan- 

sion takes the “normal form.” The ^pe term is rfth - 
In. the case of one variable, f/ »= M//V m/> so ri = 0, n = 1, r» = V^> >*4 = Pa, 
etc. In the case of two variables, fi. = r,i = 0, t%. - r. 2 - 1, ru « Pearson’s 
product-moment coefficient of correlation, etc. Functions of parameters r will 
serve to characteriae the law of correlation among the variables. 

By writing the expressions with superscript (i) to denote that the values of 
the diatributions of F and Z are those which correspond to a fixed value Xi 
of the distribution of X, we have (EY)^\ ~ (EZy'\ ftgh'^ « E{Y 

- times (Z - (For ff = h = 1, fgt}^ 

becomes the conditional coefficient of correlation between Y and Z for X s: aii.) 
Thus it follows that we can study the correlation between F and Z for each 
value of X separately. 

For second order random variables, some changes in notation can be made. 
I/et Pf and pt' be the probabilities corresponding to the values x and a/, respec- 
tively, of X; py and pg< correspond to y and y', respectively; pt and p,> correspond 
to g and 1 ^, respectively. Also, let p^y represent the probability of the simul- 
taneous occurrence of a; and y together without reference to the distribution 
of Z, etc., and p^y, represent the probability of the simultaneous occurrence of 
all three values, y, z, of their respective distributions, etc. Then, p, + p,f 
“ P» + pyi “ p» + p,» “ 1; p,v + p**' =** p* ; p*v# + p-vi' + + P»v’*> 

= Ps ; etc. 

Let us set up a System of normal coordinates in which the values Ui along 
the IZ-axiB are defined by 1/4 = , those along the V-axis by F/ * 

VM.»- 

and those along the TF-axis by Wh =» — represent the mean 

of the set of values of the Z distribution which correspond to the fixed pair of 
values, (0:4 , Vj), of the X and F distributions. Then, in the new coordinate 

system, the same thing is given by Now, the series of 

^ ^ VM-a 

values Mw obtained by giving i and j different values for the pair (jUi, V,) 
determine what is called the regression function of IF on CT and F (or, in the 
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original notation, the surface of regression of the distribution of Z on the distri- 
biitions of X and Y). Similarly, the values of [Afir obtained 

by fixing U and varying V in the set {Ui, Vj) determine -what is called the 
conditional line of regression of F on F for a fixed value of U. With these 
definitions we shall consider the problem of finding a regression function of W 
on U and V for three second order random variables. 

For convenience, write hy = = p,, - p^p„ 

fltj,* — PsJ)mv* Psu Pa*> — Paid PatfP*> Pvi ** Px'Pa'vt “ Px'vPf'tf 9tgt = 

«* — Py 5 »» “ P* 5 v* = €v ~ Par^y*."” P* 5 *y = it ~ Pv^tt — Piiay- Direct substi- 
tutions into the several formulas developed above then gives us the represent- 
ative forms to be used in subsequent calculations : 

X - mx = p*'(a! — icOi* x' - mx ~ -Px{x - x‘). 
mx. = p,2? + Pz'x', n.. = 0, ra.. - 1, n.. = 

VP.P*' 

r<.. * 3, rii. = ■ JL , rai. = ru. »•*.., 

PrP*' Vpap»'PwP»' 

ru. = ru.r.8., ru. « rn.r.4., r**. « rix.r8..r.j. -|- 1, 

nj.r2i. « rii.(r2*. - 1), r2u = rs-.rui + r.u, 

Tm =s r.j.riii -f- ri.i, rjw = r.-arm -|- ru. , 

« ^*V* tT _ P*' T 7 "“P» 

Tin — / ■ = j — > t/* — y — j 

VP.P»'PyPy'P»P.' VP.P.' VP»P.' 




P*» V P»P*' P«»' V P»P«' 


M (2JU ^jr# ;ii- (».) 

r = — ; = •- > ^1F — y — =•> 

PfvyptpM' Pt'v'Vp*P*> 


xnr (UOia-O „ «»# 

LMir J “= > = > 

pj*y V PmP«' 


(iiOiO-) 




P»'y V^P»'*P*'»' 



— «id = ——&== 

PiV' VPaPtt' ’ PsvVp#'*?*'!' 


In the case of correlation of two second order random variables, a linear 
regression function can always be found [ 3 , 6]. Similarly, the conditional 
regression functions in the case of three second order random variables can 
always be taken as linear. If we take as the form of the regression function 
of F on C/ and 7 the form = aUi -H hVj + eUiVf -H d, where a, h, c, d 
are constants to be determined by direct substitution for Ui and 7 froin the 
distributions of X and F, it is seen that linearity of all total and conditional 
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regression functions is preserved. By total regression function, we mean the 
regression of TT on U or TP" on Y, 

Now consider the problem of finding a, 6, c, d. The direct substitution pro- 
vides us with four linearly dependent equations in four unknowns. Linear 
combinations reduce the set to three, from which the relationship d == -cni. 
is obtained. By building up the various terms in the equations through dividing 
by the necessary values of p, the parameters r can be made to appear. Further 
combinations now reduce the set to the following three: 

riu = arti. + hrn. + c(r38. - rn.) 

r.u = oru. i-h -f- cr^. 

I'l-i n + 

The solution gives 


a « a' - a" 

1 - rn.* 1 - rii.* 

b - ^ __ rit. - ru;r2i. j » _ j^n 

1 — rji.® 1 — j*U'* 

c = (1 - r,i.*)(riu - o'fjg. “ bVai.) 4- A, 


c 


0 

where 


A 


1 

Tn. 

7’ii. 

I’ll. 

1 

ru. 

r%i. 

rij. 

rs2. - riiJ 


The regression function becomes 

+ bT,- - c(r„i + - UiV)), If c = 0 the surface 

is a plane. Examination of the characteristics of rm shows that generally c can- 
not be zero. The vanishing of c implies that special relations must exist between 
pijA and Pi,* , p<fc , p,-fc . 

Two constants of considerable importance in the theory of correlation are the 
multiple correlation coefl&cient and the multiple correlation ratio. For the 
regression of Tf on 1/ and V, the former is defined as iJu.* == aVi.i -f b'r.u and the 
latter as ij—i * S 2 For planar regression, the difference 

— /2ii * must vanish. For others, the difference takes on values characteristic 
of the regression function. To find the value it takes for our case, we .set up 
the value of Tf—n from the regression function, just given and subtract i2u.l 

By direct substitutiouj we have - Bu.® = £ £ Pnio.Ui + 67/ - cUiVi 

- crin)® - oVm - bVai . Since £ £ pi,*!// = 1, £ Pi,<C^f7,*)® = ras. , 

{ ■ / _ I j 

etc,, we find rather easily that 

1?-^ - fin.* =! c*(rM. - rit.®) ~ 
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We can also obtain the same value of - iSn.* by direct substitution for 
the four values of in i]-_a and subtracting Bu.l To actually obtain this 
is a long laborious process complicated by the fact that so many alternate forms 
for the answer are possible, of which only one is comparable with the value 
previously fourid. Tlie general procedure is first to set up from the definition 
the expression K = p^pt' V 2 



Then we build up each square by addition and subtraction so that it will con- 
tain a dtffB term. At the close of the process, we convert the whole expression 
into the parameters ?’ by dividing through by VtPAv*P*'PvVy*y a-iid substituting 
from the list of representative forms given at the beginning of the paper, A 
matter of rearrangement now gives the same result as bef ore. 

From the symmetry involved, we can say that, in the case of the correlation 
of three second order random variables, the function representing the regression 
of one on the other two has an equation in normal coordinates of the form 
alii + hVj - cUiVj - crui , where o, 6, and c satisfy equations of 
type 

rill = flr2i. + 6ri2. + c(ra. - ni!) 


r.ii - aril. + h + cru. 


ri,i = a -f 6ru, -h crai. 

State Bivision .ov Public Health, 

Boise, Idaho. , 
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